You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
About 10,000 deep learning papers have been written about "hard-coding priors about a specific task into a NN architecture works better than a lack of prior" -- but they're typically being passed as "architecture XYZ offers superior performance for [overly generic task category]"
You can always "buy" performance by either training on more data, better data, or by injecting task information into the architecture or the preprocessing. However, this isn't informative about the generalization power of the techniques used (which is the only thing that matters)
Basically, a lot of papers can be rephrased as "we achieved better performance on this specific task by going to great lengths to inject more information about the task in our training setup"
An extreme case of this: working with a synthetically-generated dataset where samples follow a "template" (e.g. bAbI), and manually hard-coding that template into your NN architecture
Fitting parametric models via gradient descent, unsurprisingly, works best when what you are fitting is already a template of the solution. Of course, convnets are an instance of this (but in a good way, since their assumptions generalize to all visual data).
I totally disagree. Probably because I am usually using machine learning as part of understanding a concept instead of trying to solve GAI.
Otoh, maybe it just depends on your definitions for "specific task" and "generalisable" 
"Which is the only thing that matters" - matters in what way? For finding better learning algorithms - sure, but in applications which typically seek to answer a very narrow question domain knowledge and the know-how to translate it into priors of the model is king.
I wish there was a go to paper that could provide me with enough insight into how to solve or at least improve my own models generalisation disappointment.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
