Update on Pushshift outage -- Services have been restored. Currently Pushshift is going through some growing pains due to the immense load put on the cluster. I realize that outages are always frustrating when your scripts depend on the API being up and available. That said,
Conversation
over the next month or two, we will be improving metrics monitoring and alerts (including getting a status page up with the next major release). Also, the Reddit API will be migrating over to a more powerful cluster towards autumn of this year. The primary goals right now are
1
3
improving monitoring of all system resources, minimizing the effects from outages (and reducing the frequency of outages), improving the response time when there are outages to restore services as quickly as possible and also reducing ingest latency so that that the API is never
1
1
hours behind when ingesting from various social media platforms. The entire Pushshift team is grateful to the community in helping us resolve these issues and to grow our systems to be more robust in the future.
We are going to get there soon and make the entire infrastructure
Replying to
more reliable and dependable. Thanks again for your continued support and I want to personally thank everyone for their patience and support as we grow to become more reliable.
All the best,
The Pushshift Team.
1
3