Here's my extended critique of @GaryMarcus and (indirectly) @sapinker on GPT-2, as someone who grew up reading them. tl;dr: deep learning *has* followed the programme of The Algebraic Mind, yet no one's circled back to collect the psycholinguistic insightshttps://nostalgebraist.tumblr.com/post/189965935059/human-psycholinguists-a-critical-appraisal …
-
-
Odgovor korisnicima @nostalgebraist @sapinker
honored you read my most cryptic work as a teen. have you seen my December NeurIPS talk? a preanswer to your essay. starts at 9:55 in https://slideslive.com/38922192/context-and-compositionality-in-biological-and-artificial-neural-systems-1 … f* write by doing a sophisticated extension to cut & paste: yes; f* build a model of what it is talking about: no.
1 reply 1 proslijeđeni tweet 2 korisnika označavaju da im se sviđa
i agree, it doesn't do world-modeling. it's a model of fluency in isolation -- which is interesting, and always has been! after all, there's no such thing as a wug, ideas can't be colorless OR green, and the rule-and-memory model doesn't (need to) understand the verbs it inflects
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.