I want to thank each and every Pushshift Patreon supporter. Your dedication to the project has helped us grow tremendously. We will be firing up several new ingest pipelines including 4chan, Telegram, Instagram, Twitch and many others.
The total amount of social media data is..
Conversation
now approaching 2.5 petabytes of data. The goal is to continue improving all API endpoints for social media data and to become one of the largest social media data providers for researchers so that we can better understand how social media influences and affects our society ...
2
12
By early 2022, the goal will be to secure 10 petabytes of additional storage and to increase the number of Elasticsearch nodes to 50+ nodes.