When neural circuit architecture matters more than synaptic weights: “Weight agnostic neural networks”, Gaier & Ha, 2019 https://arxiv.org/abs/1906.04358
-
Show this thread
-
Albert Cardona Retweeted hardmaru
One of the authors of “Weight agnostic neural networks” is on twitter:https://mobile.twitter.com/hardmaru/status/1138600152048910336 …
Albert Cardona added,
hardmaru @hardmaruWeight Agnostic Neural Networks
Inspired by precocial species in biology, we set out to search for neural net architectures that can already (sort of) perform various tasks even when they use random weight values.
Article: https://weightagnostic.github.io
PDF: https://arxiv.org/abs/1906.04358 pic.twitter.com/El2uzgxS5IShow this thread1 reply 2 retweets 10 likesShow this thread -
Replying to @albertcardona
So interesting! Instincts and abilities can get wired into the architecture of neural circuits so as to function w/o learning by the individual. (In animals, this is because evolution has done the deepest of deep learning already...) cc
@hardmaru@GaryMarcus2 replies 3 retweets 16 likes -
Thanks, Kevin. Glad you enjoyed the paper!
1 reply 0 retweets 3 likes -
The next question for biologists is how does evolution shape the genetic program for neural development to accomplish this? The field is starting to elucidate some nice examples of this.
3 replies 5 retweets 15 likes -
An example of a mechanism by which evolution shapes neural networks: rescuing neurons from programmed cell death, by
@neuroluci & colleagues https://www.biorxiv.org/content/10.1101/623488v2 …, and also by@LabDarren & colleagueshttps://www.biorxiv.org/content/10.1101/626465v1 …2 replies 4 retweets 15 likes -
Replying to @albertcardona @hardmaru and
Yes, lovely examples here! (Same for some sex differences in circuitry controlling response to pheromones...)
1 reply 0 retweets 3 likes -
Replying to @WiringTheBrain @albertcardona and
I always wondered how instinct was transmitted (by genes? what kinds of genes/proteins). I once heard a very eminent person claim it was done by ALU repeats but that is just silly.
1 reply 0 retweets 1 like
my book The Birth of the Mind was mostly about this question...
-
-
Replying to @GaryMarcus @HigginsDes and
Yes, a great read on the topic! And there are lots of recent examples that are starting to flesh out details of how specific circuitry (directed by specific genes) mediates specific behavioral instincts
1 reply 0 retweets 5 likes -
Replying to @WiringTheBrain @GaryMarcus and
Some references for these examples?
1 reply 0 retweets 2 likes - 2 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.