I wrote a scraper last week. It fetched all the html. Then parsed the html. Wrote a referenced img downloader. It ran. And downloaded all the images. Didn't save them anywhere though. Just burned tx/rx bytes.pic.twitter.com/Ydfk8TAtA0
(I actually fudged the facts slightly. It was scraping via an API but I didn't want to reveal whose API just yet.)
-
-
If a web scraper API by default is not saving scraped data, you'd be doing the world (and them) a favor by blowing the whistle. Fact-fudger.
-
Oh no, I mean I was fudging a little. I wasn't really "scraping" I was just paginating the results of an API at a rate limit acceptable pace ;)
- 3 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.