I am now crawling URLs of all videos uploaded to Parler. Sequentially from latest to oldest. VIDXXX.txt files coming up, 50k chunks, there will be 1.1M URLs total: https://donk.sh/06d639b2-0252-4b1e-883b-f275eff7e792/ … This may include things from deleted/private posts.
-
Show this thread
-
These are the original, unprocessed, raw files as uploaded to Parler with all associated metadata.
3 replies 13 retweets 133 likesShow this thread -
if you have the storage space for this, this is currently the best way to help out
5 replies 22 retweets 109 likesShow this thread -
I'd estimate the total size for this would be ~80TB, 4TB per chunk. It's S3/CloudFront so as much bandwidth as you can throw at it.
6 replies 5 retweets 79 likesShow this thread -
The crawl is now complete. 1098552 video URLs
5 replies 8 retweets 104 likesShow this thread -
Replying to @donk_enby
crawl = just URL listing? still need to pull them down, right?
1 reply 0 retweets 0 likes
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
Meiklejohnian absolutist. free speech as in free-for-everyone.
mutuals: