I wonder if the mindless fluency of GPT-2 is a decent account of a lot of the "filler" utterances that people make, e.g., "and I'm like, 'Well, I can live with that, right?'" They seem to be mostly rote phrases; certainly no deep understanding is needed to produce THEM 2/
-
-
Prikaži ovu nit
-
Novi razgovor -
-
-
well at least i thought of you as i wrote that word :)
-
I think GPT, BERT, and any attention-based system make a huge case against Hinton's idea of thought vectors. They do not, in fact, encode a thought as a single fixed-size vector. Instead, they use attention to revisit other vectors.
- Još 7 drugih odgovora
Novi razgovor -
-
-
"Anything that looks like genuine understanding is an illusion" sure, and I would add "including, sometimes, what passes for understanding when humans talk to each other" We converge on understanding each other well enough, but it is a fragile thing, always liable to break down.
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.