@Ylecun perpetuates false dichotomy here, between nature & nurture, without presenting data. Is there any evidence primates have fewer innate priors than mountain goats? Any proof that more innate priors actually entails less adaptivity? Better priors can yield *better* learning.https://twitter.com/ylecun/status/1180171721481113602 …
-
More innate priors can't mean faster learning. We all behave reliably stupid in the middle of a town when leaping back automatically due to a 'snake-like' twig on the pavement. Zero faster learning, here. Just the contrary. Faster learning and less adaptivity! How's that?
Convolution is perfect example of a prior that demonstrably improves learning in many circumstances; @Ylecun's own first working paper on the topic showed this decisively. [1/2]
-
-
Convolution is not knowledge. It's part of the learning mechanism. It allows the network to have a degree of positional invariance at the detriment of precision. This invariance is beneficial because, with it, the network can be trained with fewer samples. It's a crutch.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.