Computational ('connectionist') models if used correctly could not only formulate better surface forms, but reveal more of the syntactic architecture even symbolic architecture underlying. He quotes Marcus well:pic.twitter.com/2QkTeV0qFY
This is the legacy version of twitter.com. We will be shutting it down on June 1, 2020. Please switch to a supported browser, or disable the extension which masks your browser. You can see a list of supported browsers in our Help Center.
Math/ML/data-science person now working on solving aging...and helping with COVID19?! Founder, LRI and Daphnia Labs. Married to @oscredwin
You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
Add this Tweet to your website by copying the code below. Learn more
Add this video to your website by copying the code below. Learn more
By embedding Twitter content in your website or app, you are agreeing to the Twitter Developer Agreement and Developer Policy.
| Country | Code | For customers of |
|---|---|---|
| United States | 40404 | (any) |
| Canada | 21212 | (any) |
| United Kingdom | 86444 | Vodafone, Orange, 3, O2 |
| Brazil | 40404 | Nextel, TIM |
| Haiti | 40404 | Digicel, Voila |
| Ireland | 51210 | Vodafone, O2 |
| India | 53000 | Bharti Airtel, Videocon, Reliance |
| Indonesia | 89887 | AXIS, 3, Telkomsel, Indosat, XL Axiata |
| Italy | 4880804 | Wind |
| 3424486444 | Vodafone | |
| » See SMS short codes for other countries | ||
This timeline is where you’ll spend most of your time, getting instant updates about what matters to you.
Hover over the profile pic and click the Following button to unfollow any account.
When you see a Tweet you love, tap the heart — it lets the person who wrote it know you shared the love.
The fastest way to share someone else’s Tweet with your followers is with a Retweet. Tap the icon to send it instantly.
Add your thoughts about any Tweet with a Reply. Find a topic you’re passionate about, and jump right in.
Get instant insight into what people are talking about now.
Follow more accounts to get instant updates about topics you care about.
See the latest conversations about any topic instantly.
Catch up instantly on the best stories happening as they unfold.
Computational ('connectionist') models if used correctly could not only formulate better surface forms, but reveal more of the syntactic architecture even symbolic architecture underlying. He quotes Marcus well:pic.twitter.com/2QkTeV0qFY
What I think Marcus and Pinker are resisting now therefore is the idea that ML is now revealing deeper truths of the quasi-computational (or at least extremely logically rigorous, since the Chomsky stack, which was set up to counter bad machine-trans) Universal Grammar paradigm.
The surface forms are good, but insights into the presumed universal mode of human manipulation of syntax are gone. Marcus/SP seem fair. But I guess linguists cld be more excited about what GPT-2 does do... FWIW I take it for granted Chomsky would see style as a separate skill.
Sounds to me like Nostalgebraist is saying “GPT2 could be used to make discoveries about the universal mode of syntax, but nobody’s doing it”. So maybe you & he don’t disagree?
Btw am I understanding you right that “syntax”, to a linguist, means the truth claims language refers to, & is separate from style?
No. That is semantics. In classical linguistics language is made up of phonology (and orthography) - sounds (and written symbols) morphology - word composition syntax - idea-unit composition (eg sentence) semantics - 'meaning' at all levels, eg word, sentence, paragraph etc.
Why Pinker and Marcus are set off is based on the huge syntactic turn caused by Chomsky which they followed: they all believe(d) syntax was the engine of language, and Universal Grammar UG was in every head just churning out good sentences using 'localized' rules as it were.
People actually believed that?!!?!?
Yes and some, including me, sort of still do for a very good reason brought to light by Chomsky: https://en.m.wikipedia.org/wiki/Plato%27s_Problem …
I totally believe there is a hard-coded “general ability to reason symbolically” in the human brain. I think it’s pretty obviously not limited to sentence-level syntax!!
Because you get things like GPT2’s output which is logically incoherent at the paragraph or essay level, but grammatically just fine at the sentence level. It’s clearly lacking the “general symbolic reasoning” ability. Which may still be a compact thing!
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.