@Cloudflare How can I block Yandex from crawling my sites under CF?
@ebizindia Best thing to do is block by IP. We don't block by user-agent because that can be spoofed.
-
-
@CloudFlare How to get the IP range used by Yandex bots? -
@ebizindia You could also look at blocking with rules on your server. See:http://searchenginewatch.com/article/2067357/Bye-bye-Crawler-Blocking-the-Parasites …
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.