If you have recommendations for accounts that you would like added to the database so that they are constantly monitored, please let me know!
Thank you!
#bigdata #datascience #datasets
Conversation
Replying to
Non-US politicians? Could lead to interesting cross national comparisons. Requires updating each election cycle though.
1
2
Also, working in a project with @carly_r_knight where we look at the images tweeted by US congresspeople. We've got the data for that, but for future would be great if pushshift archived images from tweets too (if they aren't already).
1
5
That's a great idea -- archiving the media attached to tweets. Definitely worth it. I'll need to see how much additional space that would require but it should be doable.
If it looks to be too big, perhaps limiting to just still images (rather than video) or just things hosted on Twitter (I think they resize big uploads) would remove the really big stuff and make it manageable?
1
Yeah -- images should definitely be manageable. Once I'm done ingesting the last 3,200 tweets for every verified account, I'll take a look and see what percentage of those tweets contain images / media and run the numbers to see how much space would be needed. Also, I could...
2
Show replies