Derek Willis
Tom Lee
@derekwillis (which is just to say: if it seems like something is weird you should ignore it as Yahoo weirdess)
Lazy web: good examples of using headless browser to scrape forms like this? http://www.nvsos.gov/electionresults/PrecinctReport.aspx …
-
-
@tjl thanks!
-
-
-
@derekwillis it’s a pain in the ass, but you can actually manage to navigate http://ASP.NET sites with ajax: http://stackoverflow.com/questions/14768302/scraping-data-from-all-asp-net-pages-with-ajax-pagination-implemented … -
@derekwillis though much easier to use selenium for smaller sites. -
@derekwillis here’s a super rudimentary one i wrote for paginating two years ago: https://github.com/abelsonlive/bcni-pra …
-
-
@derekwillis there's form traversal in _pull_html(). YFF has weirdly variable login forms, so hopefully your use case is simpler. -
@derekwillis probably not a perfect example, but here's some phantomJS I wrote to scrape Yahoo Fantasy Football https://github.com/sbma44/yahoofantasyfootball/blob/master/yahoofantasyfootball/__init__.py … -
@derekwillis I think@jamesturk started a DotNet scraper. I wrote a bunch of code to scrape stuff like this in https://github.com/fgregg/legistar-scrape …
AbelsOnline
Forest Gregg
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.