In Geoff Hinton's Reddit AMA he makes a striking point about how underconstrained our brains are: https://www.reddit.com/r/MachineLearning/comments/2lmo0l/ama_geoffrey_hinton/clyjogf/ …pic.twitter.com/WmxWFl9Qbq
Unclear that the number of synapses is a measure of the number of free parameters in the brain. Real number likely orders of mag smaller.
-
-
Also unclear why seconds is a meaningful unit of time to compare with.
-
"Parameters vs data" is difficult to evaluate in DL models (information theory provides one way); far beyond our current reach for the brain
- Show replies
New conversation -
-
-
Why do you think so?
-
Unless we perfectly understand the relationship between information processing and its cellular substrate, quantifying the...
- Show replies
New conversation -
-
-
though there is also many free parameters due to other types of plasticity (such as gene expression due to homeostatic, neurogenesis, etc)
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.