In accordance to Twitter's new TOS rules that specify that an unlimites number of status ids can be shared with the academic community, Pushshift will soon be releasing very large collections of ids related to the protests, Coronavirus and other topics.
Stay tuned!
Conversation
This Tweet was deleted by the Tweet author. Learn more
Uncompressed I'm ingesting around half a petabyte of data each month and sending out between 50-100 TB of data via files.pushshift.io and the Pushshift APIs.