Selenium-controlled browsers are really good for a certain class of scraping problems -- namely, those behind a paywall. When an assertion fails, the page is still open in the browser. Otherwise, I save all sources for later inspection via BS4 (or, normally for me, lxml.html).
-
New conversation
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.