“But even this would be an important discovery – the discovery that huge swaths of what we consider most essential about language can be done “non-linguistically...”
-
-
Prikaži ovu nit
-
“It would imply that there are language-like behaviors out there in logical space which aren’t language and which are nonetheless so much like it, non-trivially, beautifully, spine-chillingly like it.”
Prikaži ovu nit -
I think this is in fact what’s going on. GPT2 can say things that don’t make sense with a fluent prose style; therefore it is possible to have style and make no sense.
Prikaži ovu nit -
In fact you can have note-perfect, sophisticated, convincing style without coming one inch closer to making sense.
Prikaži ovu nit -
Style and sense may just be two disjoint capacities. If I’m speculating I tend to think the “cortical algorithm” is for style, and sense is extrapolated from something striatal or related to motor/kinaesthetic learning.
Prikaži ovu nit -
Personally it’s frustrating because I have awesome style and just enough sense to keep up, and most of the people I know are sorta “sense-supremacists” who think that skill profile is a hallmark of bad people.
Prikaži ovu nit -
A lot of people just don’t believe in their hearts that different skills are a thing, that you can be good at one thing and bad at another. And people especially don’t like the notion that you can be better at the stylistic part of writing than the “making sense” part.
Prikaži ovu nit -
But look: my mom, who worked in academic publishing, could do a brilliant job editing a math manuscript for style without knowing calculus.
Prikaži ovu nit -
She also subconsciously imitated the accent of whoever she was speaking to. And picked up Romanian by listening to phone conversations. She had a freakishly good ear. I’m convinced this is a single phenomenon.
Prikaži ovu nit -
If I watch an episode of Peaky Blinders I’ll acquire an Irish accent by osmosis for the next hour. I subconsciously pastiche whichever writer I’ve been reading lately. I can’t *not* mirror conversational tone & emotion. One phenomenon.
Prikaži ovu nit -
I claim Scott Alexander has the same thing: writes compulsively, great at style pastiche, nobody believes him when he says he’s bad at math.
Prikaži ovu nit -
I think some people are legitimately better at style than sense or vice versa! They are not faking! Fluent pattern-matching != structural comprehension!
Prikaži ovu nit
Kraj razgovora
Novi razgovor -
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.