10-15 yrs ago, appears ~everybody talking cortical implementation of belief prop, ~nobody talking cortical implementation of back prop: https://scholar.google.com/scholar?q=related:CP4ffwsbGlcJ:scholar.google.com/&scioq=Cortical+circuitry+implementing+graphical+models&hl=en&as_sdt=0,5 … (not saying this is bad -- both very inspirational algorithms -- just interesting)
-
-
Replying to @AdamMarblestone
I literally spent a whole day arguing with Blake Richards about this on Twitter a few months ago.
1 reply 0 retweets 2 likes -
Replying to @pfau @AdamMarblestone
"Well, if this is what everyone is using at NIPS, it *must* be how the brain works!"
1 reply 1 retweet 2 likes -
Replying to @pfau @AdamMarblestone
Also,
@xaqlab would be very sad to hear that you think no one is still trying to figure out how the brain does belief propagation.3 replies 0 retweets 2 likes -
That's why I had the ~ sign in front of ~everybody (and it is anyway somewhat facetious since both communities seem quite small)! And certainly a handful or two of others still working on it. But we agree there is a major shift in the overall zeitgeist...
1 reply 0 retweets 1 like -
Replying to @AdamMarblestone @xaqlab
Graphical models got cool because Microsoft Research decided to specialize in them. Deep learning got a boost from Jeff Dean creating Google Brain in 2011. Lots of these shifts in zeitgeist have to do with the funding decisions of a few big tech companies.
1 reply 0 retweets 3 likes -
You could alternatively say "when someone pushes them hard enough to show that [some of them] can scale to real problems" -- which makes it seem at least somewhat more reasonable, less contingent/sociological
1 reply 0 retweets 1 like -
Replying to @AdamMarblestone @xaqlab
Why should scaling to optimizing ads on large datacenters be a cue for neuroscientists?
1 reply 0 retweets 1 like
Better something than nothing
-
-
Replying to @AdamMarblestone @xaqlab
Probably better to be driven by actual experimental observations from neuroscience
1 reply 0 retweets 2 likes -
Adam Marblestone Retweeted Rodney Brooks
Adam Marblestone added,
2 replies 0 retweets 2 likes - 6 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.