It's bot week: At the beginning of the week, Microsoft announced Playwright, a cross-browser instrumentation framework for Chrome, Firefox and Webkit. Now it's the turn of Puppeteer to announce full support for Firefox in addition to Chrome (github.com/puppeteer/pupp )
Conversation
You’re unable to view this Tweet because this account owner limits who can view their Tweets. Learn more
Replying to
It depends on what you mean by "easy". These bots tend to look more and more like real browsers. For example, Playwright with Firefox/webkit have navigator.webdriver = false by default.
1
However, once you start digging (what I do the whole day), you start to see a lot of subtle differences that can be used to detect bots based on these frameworks.
You’re unable to view this Tweet because this account owner limits who can view their Tweets. Learn more
Replying to
I was mostly focus on js and http requests because it was the main topic of my PhD. Now I use every signal available, which of course, includes behavior.