@Ylecun perpetuates false dichotomy here, between nature & nurture, without presenting data. Is there any evidence primates have fewer innate priors than mountain goats? Any proof that more innate priors actually entails less adaptivity? Better priors can yield *better* learning.https://twitter.com/ylecun/status/1180171721481113602 …
-
-
Replying to @GaryMarcus @ylecun
I agree there is a tradeoff. But what would constitute evidence? How would you quantify "number of innate priors"? BTW I think even in primates most everything is innate. Maybe 99% in goats and 98% in primate--x2 higher, but still low. (Arbitrary units).pic.twitter.com/DZtVnVgB30
3 replies 1 retweet 10 likes -
Replying to @TonyZador @ylecun
Peter Marler, Steve Pinker, Noam Chomsky, Elizabeth Spelke and I have all argued that the tradeoff goes in opposite direction: better priors -> better learning. just like in
@ylecun 1989 tech report which showed better results as amount of built in info increased:pic.twitter.com/a49Kr1LLZj
2 replies 0 retweets 6 likes -
Replying to @GaryMarcus @ylecun
These are not incompatible positions. Yes, better priors --> better learning. E.g. goats have very poor priors for language, so they don't learn to speak. So they rely on life strategies that involve learning fewer things, and rely more on innate strategies.
2 replies 1 retweet 6 likes -
Replying to @TonyZador @ylecun
i worry deeply about the deep learning community because so many bill themselves as experts on learning yet fail to grasp
@TonyZador’s point above, revealing a deep lack of familiarity in ML with neighboring literature like ethology.7 replies 2 retweets 8 likes
Gary Marcus Retweeted François Chollet
@fchollet just made this point nicely:https://twitter.com/fchollet/status/1180541041947971584?s=21 …
Gary Marcus added,
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.