@ClicksIM is this what you're looking for? http://en.wikipedia.org/wiki/Robots_exclusion_standard#Crawl-delay_directive
You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
@ClicksIM is this what you're looking for? http://en.wikipedia.org/wiki/Robots_exclusion_standard#Crawl-delay_directive