Yes, lots of progress. Using representations learned by GPT-2 and similar models, you can improve performance on many NLP tasks. GPT-2 is about representation learning, not about sentence completion or conversation.
2014: Classical AI chatbot Eugene Goostman knows little but fools some people into thinking it is human, by answering questions evasively but fluently. 2019: Neural net GPT-2 knows little, fools some people into thinking it is human, by being evasive but fluent. Progress?pic.twitter.com/ucAcvevSCW
-
-
-
my point is that all that progress on “representation learning” has NOT had a tangible impact on getting AI to understand narrative, dialog, stories, articles etc. it may even be a distraction.
- 4 more replies
New conversation -
-
-
Ummm....Turing?!?
-
That is an important point. Turing was well aware that evasive (and even incorrect) answer are part of “intelligence.”
- 2 more replies
New conversation -
-
-
Fluent, *sometimes*. Who says GPT-2 doesn't do hierarchies of symbols - I'll have whatever full-size GPT-2 is having...pic.twitter.com/pHugZp912p
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
I was thinking "May the force be with you." So the "best man," in this case, was
@Google.pic.twitter.com/QJFfsAsm99
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
It reminds me of discussions with some folks on Twitter... ;)
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Reminds me of that IBM Watson commercial with Bob Dylan: Watson: The themes in your songs are time passes and love fades Dylan: Wanna write a song together? Watson: ... I can sing!https://www.youtube.com/watch?v=8yHC3xFIYa4 …
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Eliza and I are about the same age. While I'm no genius, I'm pretty sure that I have advanced a lot more 'cognitively' in the past 55 years. Then again, I -am- pretty tired and hungry.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
We need some kind of kilowatts per Turing metric (kT) which would reflect that, no, not progress.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.