crash override

@donk_enby

26 • she/her • Mobile RE/Data Spelunking 🌈 Meiklejohnian absolutist. free speech as in free-for-everyone. mutuals:

Wien
Joined January 2020

Tweets

You blocked @donk_enby

Are you sure you want to view these Tweets? Viewing Tweets won't unblock @donk_enby

  1. Pinned Tweet
    Jan 9

    RELEASE: Every Parler post made during the 06/01/2021 US Capitol riots. (batches of 100k URLs, for archival purposes)

    Show this thread
    Undo
  2. 3 hours ago

    50gbps at one point, must have been some pretty graphs

    Show this thread
    Undo
  3. 4 hours ago

    good night and thank you for keeping those servers up as long as you did :)

    Show this thread
    Undo
  4. 4 hours ago

    great job, everyone

    Undo
  5. 6 hours ago

    the raw videos are now in the project queue

    Show this thread
    Undo
  6. 7 hours ago

    here it is on a graph

    Show this thread
    Undo
  7. 7 hours ago

    we are currently collectively pulling in posts at about 1.6Gbps

    Show this thread
    Undo
  8. 8 hours ago

    i should probably warn you that if you do this, it will cost you $3k in S3 egress fees to get it back out. but now we know it's 30TB total.

    This Tweet is unavailable.
    Show this thread
    Undo
  9. 13 hours ago

    somebody shared this with me for mirroring the videos to S3 fast

    Show this thread
    Undo
  10. 13 hours ago

    use watchtower to automatically check for updates to the docker image. lower the default checking threshold from 24h to 5 minutes. instructions are on the wiki.

    Show this thread
    Undo
  11. 13 hours ago

    The crawl is now complete. 1098552 video URLs

    Show this thread
    Undo
  12. 13 hours ago
    Show this thread
    Undo
  13. 13 hours ago

    There is now a Docker image you can run to help out with 's Parler archival effort: docker run --detach --name "at_parler" --restart always --concurrent 20 NICKNAME

    Show this thread
    Undo
  14. 15 hours ago

    I'd estimate the total size for this would be ~80TB, 4TB per chunk. It's S3/CloudFront so as much bandwidth as you can throw at it.

    Show this thread
    Undo
  15. 15 hours ago

    Amazon will pull the plug at 11:59PM PST.

    Undo
  16. 16 hours ago

    for anyone who wants to create a lot of parler accounts:

    Undo
  17. 17 hours ago

    for anyone who also wants to grab all the images from Parler: {insert sequential integer here}. no auth needed.

    Undo
  18. 17 hours ago
    Undo
  19. 18 hours ago

    if you have the storage space for this, this is currently the best way to help out

    Show this thread
    Undo
  20. 18 hours ago

    These are the original, unprocessed, raw files as uploaded to Parler with all associated metadata.

    Show this thread
    Undo
  21. 18 hours ago

    I am now crawling URLs of all videos uploaded to Parler. Sequentially from latest to oldest. VIDXXX.txt files coming up, 50k chunks, there will be 1.1M URLs total: This may include things from deleted/private posts.

    Show this thread
    Undo

Loading seems to be taking a while.

Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.

    You may also like

    ·