gpt2 isn't "a ton of data + dumb vanilla empiricist putty," it's "a ton of data + an architecture with a strong track record at linguistic tasks." is that architectural choice not "nativist" "enough" to "count"? for what well-motivated defn. of those terms?
-
-
-
terrible track record on semantics
- Još 3 druga odgovora
Novi razgovor -
-
-
This
sounds like a misunderstanding: of course we can understand a sentence like this without access to images.
But we learn to understand sentences like this by connecting words with things we experience in the world, like sounds and images, not just by reading lots of text.pic.twitter.com/50JjBedfwA
-
i would urge to read and consider Landau and Gleitman’s book on blind children acquiring language. images certainly are NOT prerequisite.
- Još 3 druga odgovora
Novi razgovor -
-
-
This is article features some tangled logic.https://www.linkedin.com/posts/martingoodson_gpt-2-and-the-nature-of-intelligence-activity-6627153800736059392-N6p8 …
-
there is no coherent argument that i can discern in what you just posted, sorry.
- Još 5 drugih odgovora
Novi razgovor -
-
-
Beautiful piece! Take home message is attached. 1 place not totally clear is what’s Dr Marcus’ definition of “understanding”. The statement “what language comprehension is really about is not prediction but interpretation” seems to demand a more detailed follow-up.
@luislambpic.twitter.com/HYixFWAhQWOvo je potencijalno osjetljiv multimedijski sadržaj. Saznajte više
-
agreed
Kraj razgovora
Novi razgovor -
-
-
I think the following is a mistake: "Nowadays, with enough money and computer time, we can actually test this sort of theory, by building massive neural networks, and seeing what they learn". Key to nativist claim is that humans need to learn with limited experience, unlike here
-
what's the mistake? 40GB is still limited (finite) experience, but enough to give empiricism a serious test.
- Još 1 odgovor
Novi razgovor -
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.
