“It would imply that there are language-like behaviors out there in logical space which aren’t language and which are nonetheless so much like it, non-trivially, beautifully, spine-chillingly like it.”
-
Prikaži ovu nit
-
I think this is in fact what’s going on. GPT2 can say things that don’t make sense with a fluent prose style; therefore it is possible to have style and make no sense.
1 reply 1 proslijeđeni tweet 17 korisnika označava da im se sviđaPrikaži ovu nit -
In fact you can have note-perfect, sophisticated, convincing style without coming one inch closer to making sense.
1 proslijeđeni tweet 12 korisnika označava da im se sviđaPrikaži ovu nit -
Style and sense may just be two disjoint capacities. If I’m speculating I tend to think the “cortical algorithm” is for style, and sense is extrapolated from something striatal or related to motor/kinaesthetic learning.
0 proslijeđenih tweetova 8 korisnika označava da im se sviđaPrikaži ovu nit -
Personally it’s frustrating because I have awesome style and just enough sense to keep up, and most of the people I know are sorta “sense-supremacists” who think that skill profile is a hallmark of bad people.
0 proslijeđenih tweetova 8 korisnika označava da im se sviđaPrikaži ovu nit -
A lot of people just don’t believe in their hearts that different skills are a thing, that you can be good at one thing and bad at another. And people especially don’t like the notion that you can be better at the stylistic part of writing than the “making sense” part.
3 proslijeđena tweeta 15 korisnika označava da im se sviđaPrikaži ovu nit -
But look: my mom, who worked in academic publishing, could do a brilliant job editing a math manuscript for style without knowing calculus.
1 proslijeđeni tweet 14 korisnika označava da im se sviđaPrikaži ovu nit -
She also subconsciously imitated the accent of whoever she was speaking to. And picked up Romanian by listening to phone conversations. She had a freakishly good ear. I’m convinced this is a single phenomenon.
1 reply 0 proslijeđenih tweetova 11 korisnika označava da im se sviđaPrikaži ovu nit -
If I watch an episode of Peaky Blinders I’ll acquire an Irish accent by osmosis for the next hour. I subconsciously pastiche whichever writer I’ve been reading lately. I can’t *not* mirror conversational tone & emotion. One phenomenon.
1 reply 0 proslijeđenih tweetova 12 korisnika označava da im se sviđaPrikaži ovu nit -
I claim Scott Alexander has the same thing: writes compulsively, great at style pastiche, nobody believes him when he says he’s bad at math.
0 proslijeđenih tweetova 19 korisnika označava da im se sviđaPrikaži ovu nit
I think some people are legitimately better at style than sense or vice versa! They are not faking! Fluent pattern-matching != structural comprehension!
-
-
Odgovor korisniku/ci @s_r_constantin
Spectrum disorders may in part be explained by differences in attention. GPT-2 is a deeper model, but it is not a fully integrated one. Meaning is given by the relationships to a more or less unified model of the universe. I wonder if we need to go deeper, sparser or different.
1 reply 0 proslijeđenih tweetova 1 korisnik označava da mu se sviđa -
Odgovor korisnicima @Plinz @s_r_constantin
Pattern matching and prediction has proved sufficient for creativity, but not understanding. I think reflection and *integration* (unification) are the sort of things needed for understanding. Yes, meaning is given by integrating ideas into a global model
1 reply 0 proslijeđenih tweetova 1 korisnik označava da mu se sviđa - Još 3 druga odgovora
Novi razgovor -
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.