Now now. I didn't say they understand nothing; you know very well I wouldn't claim that. The "extend this prompt" demos show that the new models extend the span of "local coherence" far beyond what n-gram models would capture. But they also reveal major semantic failures...
Last week: Deep learning is on verge of understanding natural language. Problem of tracking world change over time solved 3 years ago. This week: Nobody ever said statistical language models understand anything.https://twitter.com/tdietterich/status/1191756945226522624 …
-
-
-
real question is whether deep learning alone can maintain representations of the world as it unfolds in a narrative / article etc. aside from highly limited worlds of the FB babi tasks, i have not seen any evidence that they can. and gave principled reasons to think otherwise.
- 8 more replies
New conversation -
-
-
Hi there. Reading Rebooting AI right now and loving it. Thanks for this excellent book!
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
10 years ago, self-driving car companies began mixing deep learning with symbolic AI in the hope of eventually making a full self-driving (FSD) vehicle. Today, they're still hard at work mixing DL with GOFAI but FSD is nowhere in sight. Gary Marcus: "We need hybrids."
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.