So bottom line is - no - we are not even close to AGI right now. Even simulated conversations like GPT-2 are crappy.https://twitter.com/GaryMarcus/status/1194072212841517056 …
You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
Agreed! However, the closer we are getting to imitating humans, the more the general population is getting nervous about AGI becoming real - and achievable in the next few years. The depth of semantics and commonsense required for AGI is what I wanted to highlight.
that’s retrenchment and revisionist history. few months ago people were perfectly happy to talk about gpt-2 as an understanding tool; it’s in the original paper, the title of the Bet paper, sutskekers quote to the New Yorker, etc. i have posted about this before.
I don't find this claim in the GPT-2 paper, and have not met any serious researcher who claimed that GPT-2 is able to understand text in any real sense. The NLU community may use the word "understanding" more broadly than it should, but is very aware of the limitations.
I suspect if you trained on longer contexts either with a sparse transformer or LSTMed between each response and query, you might do a better job with running context. But we would still be no closer to an AGI - just a (marginally) better chatbot.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.