Last.fm’s robots.txt has some pretty specific instructions for robots: http://www.last.fm/robots.txt
11:24 PM - 27 Jul 2010
0 replies
2 retweets
2 likes
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
JavaScript, HTML, CSS, HTTP, performance, security, Bash, Unicode, i18n, macOS.