Our systems need millions of human-reviewed data points to improve and that takes time, we did recently release an update that resulted in 30% less yellow icons overall and we're continually making further improvements!
You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more