I wrote a scraper last week. It fetched all the html. Then parsed the html. Wrote a referenced img downloader. It ran. And downloaded all the images. Didn't save them anywhere though. Just burned tx/rx bytes.pic.twitter.com/Ydfk8TAtA0
-
-
-
Replying to @mattmayo13
(I actually fudged the facts slightly. It was scraping via an API but I didn't want to reveal whose API just yet.)
1 reply 0 retweets 0 likes -
Replying to @generativist
If a web scraper API by default is not saving scraped data, you'd be doing the world (and them) a favor by blowing the whistle. Fact-fudger.
1 reply 0 retweets 1 like -
Replying to @mattmayo13
Oh no, I mean I was fudging a little. I wasn't really "scraping" I was just paginating the results of an API at a rate limit acceptable pace ;)
1 reply 0 retweets 1 like -
Replying to @generativist @mattmayo13
I just...uh...forgot to save the data in the second round :(
1 reply 0 retweets 1 like -
Replying to @generativist
When you've felt out your opponent for a round, and you've got their number, but forget to throw any punches the following round. That hurts :)
1 reply 0 retweets 1 like
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.