You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
This definition draws a clear boundary: some things are DL, some things aren't. The 2019 flavors of DNNs are DL, of course. So are DNNs trained with backprop alternatives like ES, ADMM, or virtual gradients. Genetic programming is not DL. Quicksort is not DL. Nor is SVM.
A single Dense layer is not DL. But a Dense stack is.l DL. K-means is not DL. But stacking k-means feature extractors is DL. When in 2011-12 I was doing stacked matrix factorization over matrices of pairwise mutual information of locations in video data, that was deep learning.
Programs typically written by human engineers are not DL. Parametrizing such programs to learn a few constants automatically is still not DL. You need to be doing representation learning with a chain of feature extractors.
By definition, deep learning is a gradual, incremental way to extract representations from data. In its modern incarnation, it's even at least C1 continuous (more typically C inf). That last part isn't essential, but *incrementality* is intrinsic to DL.
So DL is a fundamentally different beast from symbol manipulation and regular programming, which is fundamentally discrete, flow-centric, and doesn't usually involve intermediate data representations. You could do symbol manipulation with DL, but it involves lots of extra steps.
These are two entirely different takes on data manipulation. Deep learning isn't just end-to-end gradient descent, but not every program is deep learning either. In fact, deep learning models only represents a tiny, tiny slice of program space. It can't hurt to look beyond it.
Great thread, but do you have any references I could look at re: the mutual info matrix factorization on video data thing? Sounds interesting...
With this definition, then extracting KAZE or SIFT vectors, and encoding them as Fisher vectors or VLAD could be considered deep learning? As there are multiple "layers" of representations being computed? But I would argue this is not deep learning, and the definition is too wide
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
