Pushshift will be rolling out some new API endpoints (especially for Reddit data). The current production API endpoint is unfortunately behind quite a bit due to limitations in the ingest code. I will be releasing a new endpoint in the next few days that will have a redesigned
Conversation
Replying to
ingest pipeline that can handle the increase in Reddit volume so that it won't fall behind by more than 20-30 seconds. This is a high priority for researchers who depend on near real-time data. Eventually all data will be migrated over to the new endpoint along with filling any
1
13
data gaps that currently exist. The new endpoint for comments and submissions will be announced in the next few days so stay tuned -- we're working hard to improve all aspects of our ingest pipelines.
13
Replying to
Do you think you will add back the &aggs=subreddit aggregate numbers endpoint again?
2
Replying to
I assume this is why your website is down now and we can't get access to the old endpoints?
Show additional replies, including those that may contain offensive content
Show