You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
My guess is that the purpose of this isn't to steal your data and invade your privacy; it's to fool us into the false sense of security of believing that this is how the FBI would go about stealing our data if they were going to (and we didn't install it, so we're "smart")!