Antoine Vastel@xopek59New example of crawler (parallel golang crawler) added to the bot zoo:github.combots-zoo/parallel_http.go at main · antoinevastel/bots-zooContribute to antoinevastel/bots-zoo development by creating an account on GitHub.10:31 AM · May 13, 2021·Twitter Web App
ronan cremin@xbs·May 13, 2021Replying to @xopek59Are the UAs in https://github.com/antoinevastel/bots-zoo/tree/main/headers/userAgents.txt… supposed to be all bots?github.combots-zoo/userAgents.txt at main · antoinevastel/bots-zooContribute to antoinevastel/bots-zoo development by creating an account on GitHub.1
Antoine Vastel@xopek59·May 13, 2021Replying to @xbsNo, there are all kinds of UAs: bots/browsers/software1
