I want to thank each and every Pushshift Patreon supporter. Your dedication to the project has helped us grow tremendously. We will be firing up several new ingest pipelines including 4chan, Telegram, Instagram, Twitch and many others.
The total amount of social media data is..
Conversation
now approaching 2.5 petabytes of data. The goal is to continue improving all API endpoints for social media data and to become one of the largest social media data providers for researchers so that we can better understand how social media influences and affects our society ...
Replying to
By early 2022, the goal will be to secure 10 petabytes of additional storage and to increase the number of Elasticsearch nodes to 50+ nodes.
12
Replying to
Hey Jason! I was just wondering if you are still processing deletion requests. Sorry if I seem impatient, I was wondering as myself and several other users have not received a reply regarding pushshift deletions. Thanks you, and keep up the good work!