Jacob Harris
While I’m musing about Tor, has anybody tried web scraping through Tor?
-
@thejefflarson I know it was slow, but how was it?
Jeff Larson
@harrisj worked wonderfully actually, every once in a while you have to restart to get a new exit node.
-
-
@thejefflarson I kinda wish I had time to work on this sort of stuff, but also scared about doing it wrong. -
@harrisj yeah straight fear has me doing the cryptopals challenges. I’m only on the first one. -
@thejefflarson I kinda want the NYT and PP to team up on this stuff
-
-
-
@thejefflarson@harrisj I’ve done it before, good results. (protip: get tor PID, script occasional “kill -HUP $PID” in scraper for new ip) -
-
-
@thejefflarson@harrisj interesting
Mike Tigas
gabriel dance
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.