I am now crawling URLs of all videos uploaded to Parler. Sequentially from latest to oldest. VIDXXX.txt files coming up, 50k chunks, there will be 1.1M URLs total: https://donk.sh/06d639b2-0252-4b1e-883b-f275eff7e792/ … This may include things from deleted/private posts.
-
-
if you have the storage space for this, this is currently the best way to help out
Show this thread -
I'd estimate the total size for this would be ~80TB, 4TB per chunk. It's S3/CloudFront so as much bandwidth as you can throw at it.
Show this thread -
The crawl is now complete. 1098552 video URLs
Show this thread -
somebody shared this with me for mirroring the videos to S3 fasthttps://github.com/tkellen/parlerdump …
Show this thread -
i should probably warn you that if you do this, it will cost you $3k in S3 egress fees to get it back out. but now we know it's 30TB total. https://twitter.com/tkellen/status/1348403709592674310 …
This Tweet is unavailable.Show this thread
End of conversation
New conversation -
-
Show additional replies, including those that may contain offensive content
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
Meiklejohnian absolutist. free speech as in free-for-everyone.
mutuals: