Sutskever to @NewYorker: "If you train a system which predicts the next word well enough, then it ought to understand"
ML fans when I show GPT-2 has no idea what happens as events unfold over time: GPT-2 is just system for predicting next words; not fair to ask it to understand.
-
-
On this point I'd just say it's a particular term used in the field for a specific thing. When people say 'Computer Vision' to refer to an endeavour in AI they don't mean to claim their model has human level vision (which incidentally is worse that hawk level vision etc etc)
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Don't bother with namings. The L in ML also stands for learning but none is there.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
An unconditioned language model isn’t worth much. It’s just a parrot. The conditioning is where the understanding needs to come in
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.