Update on Pushshift outage -- Services have been restored. Currently Pushshift is going through some growing pains due to the immense load put on the cluster. I realize that outages are always frustrating when your scripts depend on the API being up and available. That said,
Conversation
over the next month or two, we will be improving metrics monitoring and alerts (including getting a status page up with the next major release). Also, the Reddit API will be migrating over to a more powerful cluster towards autumn of this year. The primary goals right now are
1
3
improving monitoring of all system resources, minimizing the effects from outages (and reducing the frequency of outages), improving the response time when there are outages to restore services as quickly as possible and also reducing ingest latency so that that the API is never
1
1
hours behind when ingesting from various social media platforms. The entire Pushshift team is grateful to the community in helping us resolve these issues and to grow our systems to be more robust in the future.
We are going to get there soon and make the entire infrastructure
1
2
more reliable and dependable. Thanks again for your continued support and I want to personally thank everyone for their patience and support as we grow to become more reliable.
All the best,
The Pushshift Team.
1
3
Replying to
Hi JSON and Pushshift team, thanks for fixing the outage so quickly! I really appreciate the API, it's super useful and easy to use. Please keep it going for as long as possible! I sent a small donation your way.
1
1
Replying to
Thank you Paul for your support! It really helps us to continue to provide services and expand. Pushshift won't be going anywhere -- we're continuing to add new social media platforms while improving our existing infrastructure.
Thanks again for your donation!