GPT-2 also can't keep track of objects placed into relations:https://twitter.com/beausievers/status/1164589940358803457?s=20 …
Does #deeplearning "understand" natural language? Has common sense been solved? Try for yourself at http://talktotransformer.com , from @AdamDanielKing.
Here's a sample from this morning, my question in bold, transformer network answer at bottom, starts "It's the same as... "pic.twitter.com/SMd8VDLh0h
-
-
-
nice. sorry I missed your original tweet!
- 2 more replies
New conversation -
-
-
-
Of course I never, ever ever said that the problem of understanding has in way been solved, but when you are auto-fabricating, it doesn't matter. Machine-generated
#fakenews.
End of conversation
New conversation -
-
-
I could not resist to test the
#PlushGiraffePerturbation...
pic.twitter.com/JyPDWDjQQV
-
it started well, before an unplanned crash landing
End of conversation
New conversation -
-
-
a perfect mix of coherent and incoherent, part true, part false, powered by a powerful, statistics-drenched riff on the kind of cut-and-paste that has fueled many a late night term paper.
- 1 more reply
New conversation -
-
I asked GPT-2 that very question, and the output provides a clear indirect answer....
pic.twitter.com/5IQkAiv5Bz
- 3 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.