I am currently ingesting information for all available Reddit subreddits and should have it ready for download in a couple days. To give you an idea of how many subreddits there are, take look at this link: beta.pushshift.io/reddit/search/
#bigdata #reddit #datascience
Conversation
Also, please let me know if you could use a hand in getting your latest data up on BigQuery. The fh_bigquery dataset could use an update and I'd love to help somehow!
1
Replying to
I am working with to get the data caught up in BigQuery. March was a tough month for me family wise but things are returning to normal (whatever normal means in today's world). I also needed to fix a few things with the ingest script the March comment ingest got
1
delayed. However, March is almost complete now and then April will quickly follow. Let me know if you have any questions! I'll make an announcement here once the new monthly dumps are ready.