The Pushshift database now contains over 164,250,000,000 social media objects and counting.
Conversation
Replying to
Approaching mind-boggling scale. I'm assuming there's a fair amount of repetition in content....any storage efficiencies to be gained from it?