That may not be a decisive argument, because the innate structure would have to be discovered through an evolutionary search, which a machine learning algorithm can perform as well.
-
-
-
@Plinz No it can't. You are projecting your massive knowledge & experience on ML/DL systems. They don't do what you say they do. Evolutionary Strategies is all about drawing a few samples from a frequentist probabilistic distribution & combining the best performing samples.
Kraj razgovora
Novi razgovor -
-
-
Marcus says GPT-2 is a "vector-based system" therefore its lack of human-level understanding (despite inconsistent glimmers of accurate association & discrimination) disproves the "thought vector" hypothesis. But I've never heard that GPT-2 was an attempt to implement reasoning.
-
this is a little garbled. the problem is not just vectors, it’s a lack of innate structure.
- Još 1 odgovor
Novi razgovor -
-
-
Not a single mention of Skinner... and yet this is a complete match with what was predicted in his Verbal Behavior. How hard would it be to drop theories where "the mind is what the brain does" for something closer to "the mind is what the body does" i.e. thinking is behaving?
-
This. How does one distinguish "innateness" from "embodiment"? The body gives the mind structure. A disembodied (non-robotic) AI won't replicate it. An embodied AI might, by virtue of the structural constraint of its body, which creates meaning.
Kraj razgovora
Novi razgovor -
-
-
"think and speak"? Since when is thinking part of UG? And given how grammatical GPT-2 output is, I'd say it passes the syntax bit pretty damn well... (doesn't mean the output makes sense, but then sense was never part of UG either)
-
Pinker has been quite clear about a conception of nativism that extends beyond syntax. nothing new there; consider eg last chapter of The Language Instinct, 1994.
Kraj razgovora
Novi razgovor -
-
-
I'd say the model's success at generating grammatically correct language doesn't disprove that language has structure ("Chomsky") but rather shows that a deep learning system has the ability to pick up that structure without it being programmed in or even explicitly represented.
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
-
-
If AI could learn language that might disconfirm Chomsky-type innateness. AI failing to learn language is inconclusive at best. Much better to focus on language acquisition of a wide range of languages.
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.