I will begin releasing "Academic Packs" that contain social media information for important events. The first packages will be politically related. I am creating an academic pack for Cohen's testimony which will include the complete video of his testimony, Twitter data, videos ..
Conversation
Replying to
from Twitter and other social media sources, Reddit data, etc. I hope that these academic packs aid researchers and future historians so that these events are thoroughly recorded and archived. The Cohen pack will be available in a few days.
#bigdata #datascience #datasets
1
2
10
Additional info: These packages will be tar files that are compressed with zstd compression. Within the tar files will be multiple folders for media (videos and images), social media data along with a sqlite3 database. I will include complete instructions on how to use the data.
6
Replying to
Awesome! How do you deal with Twitter not allowing sharing of this type of data?
Replying to
That's a great idea! For academics, it would be awesome if you would add a short tech report on arxiv.org that describes the methods for the particular dataset. It would make it easier to cite and would improve visibility on Google Scholar.
1
4
Replying to
Yeah -- I intent to include methodology on how the data was ingested, etc. That's one of the goals -- also to keep this better organized.
Thank you!
1
