Pushshift is currently working on dumping a massive amount of #reddit comment data to update the monthly comment files located at files.pushshift.io/reddit/comments.
One of the reasons for the delay was due to having to refactor some code to deal with large spamming runs on Reddit.
Conversation
Replying to
Once the monthly files are dumped, they then need to be compressed and moved to the file server.
Additionally, there is some extra metadata attached to each comment object. Normally, Reddit does not supply the creation epoch time for a user. Pushshift adds that field to the
1
1
dumps to allow for additional analysis that may use the user's account age for various research purposes.
We are dumping and preparing the files for download and I will update again when they are ready for consumption.
1