Autonomous driving is the ultimate example. You could use deep learning to create an impressive self-driving car prototype in 2015 on a shoestring budget (Comma did exactly that, using Keras). Five years and billions of $ later, the best DL-centric driving systems are still L2+.
-
-
Show this thread
-
Every app demo based on GPT-3 follows this pattern. You can build the demo in a weekend, but if you invest $20M and 3 years fleshing out the app, it's unlikely it will still be using GPT-3 at all, and it may ever meet customer requirements
Show this thread -
The reason why is that parametric models trained with gradient descent make it easy to automate something, but have little ability to deviate from the patterns they've learned. Meanwhile, the real world is full of surprises, and handling it requires the ability to adapt.
Show this thread
End of conversation
New conversation -
-
-
Which are all reasons to use Information Theory. This is a clear well-define, mathematical framework, featuring formulae that are used independently showing their usefulness. Kullback Leibler Divergence and Mutual information are even used in climate science!! >>
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
it gets exponentially hard to achieve perfection
-
Even to get to predictability it appears.
End of conversation
New conversation -
-
-
That’s where we struggle all the time...
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Freeman Dyson wrote a review on Information Theory in the New York Review of Books, dealing with communication:https://boingboing.net/2011/02/27/freeman-dyson-review.html …
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
That's absolutely been the experience! Consistent usefulness and reliability out of DL is a big challenge.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Fully agree. Run into situations at work where I read an impressive dl paper and try to put a prototype of it into production only to realize that what looked good about the findings only did so on paper i.e. very difficult to get working in production
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.