. @Ylecun are you arguing that your team has a robust solution to the problem of getting deep nets to understand the causal consequences of events as they unfold over time, or just pointing me to a toy model? Have you tried it on the examples in this thread?https://twitter.com/ylecun/status/1188902027495006208 …
Not only did @ylecun claim the problem of buiding models of causal consequences from discourse was solved, he said it's been solved for 3 years! Spoiler: It hasn't been.
-
-
Did he really? My read: You claimed no robust event representations in GPT-2, he claimed (albeit rudely) that older work exhibited this property.
-
right, which makes his reply a non sequitur. I said GPT-2 doesn''t develop robust representations of *how events unfold over time*; he pointed to a different architecture w memory etc. bait-and-switch and overstated.
- 2 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.