My favourite robots.txt is still last fm http://www.last.fm/robots.txt #ndcoslo #asimov
Replying to @codepo8
I’ve always liked @janmoesen’s: http://jan.moesen.nu/robots.txt
8:23 AM - 9 Jun 2016
0 replies
3 retweets
4 likes
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
JavaScript, HTML, CSS, HTTP, performance, security, Bash, Unicode, i18n, macOS.