Sutskever to @NewYorker: "If you train a system which predicts the next word well enough, then it ought to understand"
ML fans when I show GPT-2 has no idea what happens as events unfold over time: GPT-2 is just system for predicting next words; not fair to ask it to understand.
-
-
Very evidently current
#AI/#NLProc suffers from reading comprehension disability: https://www.verywellfamily.com/learning-disability-in-reading-comprehension-2162449 … Reasons differ, of course, but probably there's something to learn from reasons of why this disability manifests in humans?Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
From what I’ve seen from GPT-2 so far is not much better if not worse than what the good old computer science paper generator could do - minus the syntactic and grammatical correctness. https://pdos.csail.mit.edu/archive/scigen/
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
What's the precise, measurable definition of "understanding" at play here? Should agree on definitions of essential concepts to focus discussion.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.