The fact that you can selectively turn off parts of cortex (e.g. via cooling) and the brain keeps working fine with only very specific deficits probably tells us all we need to know about the importance of backprop in biological learning.
-
-
Neither of these is a perfect example of what David is asking for. But as Konrad and Greg and I wrote in 2016, the use of backprop like credit assignment signals internally does not imply a monolithic end to end training from a single objective...pic.twitter.com/BUSoQKazlp
-
Consider an architecture where each module predicts its many inputs as a function of its outputs and some global conditioning. Might be very modular, despite the use of backprop like gradient flows.
- 12 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.