api.pushshift.io recently broke half a million requests for a 24 hour period and didn't break a sweat! The entire project now utilizes 6 servers (4 dedicated as ES nodes with a total of 768 gigabytes of RAM). The bandwidth has been increased to 1,000 Mbps.
Conversation
Replying to
I made this with the API instead of BigQuery recently, saved me a lot of time and learned how to use aggs! Check out ’s Tweet:
