Pushshift currently has over 350 terabytes of social media data relating to the Coronavirus pandemic. We're adding approximately 5-10 terabytes per day.
#coronavirus #bigdata
Conversation
This Tweet was deleted by the Tweet author. Learn more
Also, I'm open to any suggestions / recommendations for software applications that you would recommend that can scale well for this amount of data.
Thanks!