I am now crawling URLs of all videos uploaded to Parler. Sequentially from latest to oldest. VIDXXX.txt files coming up, 50k chunks, there will be 1.1M URLs total: https://donk.sh/06d639b2-0252-4b1e-883b-f275eff7e792/ … This may include things from deleted/private posts.
-
-
somebody shared this with me for mirroring the videos to S3 fasthttps://github.com/tkellen/parlerdump …
Show this thread -
i should probably warn you that if you do this, it will cost you $3k in S3 egress fees to get it back out. but now we know it's 30TB total. https://twitter.com/tkellen/status/1348403709592674310 …
This Tweet is unavailable.Show this thread
End of conversation
New conversation -
-
-
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
crawl = just URL listing? still need to pull them down, right?
- End of conversation
New conversation -
-
-
Superb... what’s the total S3 bucket size [or size of multiple buckets]?
-
~80TB total is my estimate
End of conversation
New conversation -
-
-
As little as I know about this stuff, i can recognize you're a fucking hero. It may not get recognized on the scale it deserves, but this seems vital to holding these ppl accountable.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
Meiklejohnian absolutist. free speech as in free-for-everyone.
mutuals:
