New Reddit monthly dumps are available (and tons more on the way this evening and tomorrow!) Over 2 billion comments and 400+ million submissions. 2021 comment data will be competed tonight.
Location: repo.pushshift.io/reddit/comment
#datascience #bigdata #reddit
Conversation
Replying to
I will update on the meta data for these files later but if you need to grab new data, keep checking the website this evening and tomorrow. All comments should be up by tomorrow at 5pm and all submissions by midnight tomorrow!
5
Replying to
Files uploaded just now:
RC_2021-07.zst
RC_2021-08.zst
RC_2021-09.zst
Months 10, 11 and 12 are on their way up now and should be available within the next hour or two!
3
Replying to
This data also has additional metadata not available via Reddit's standard API including author creation times for all available authors (~90% completion rate).
3