What do you mean by bootstrapping in this context?
-
-
Replying to @WiringTheBrain @TonyZador and
How code can build on code / how the architecture impact of learned intelligence impacts future architectural impacts. We start with the same wiring but early experiences change the trajectory for future architectural changes.
1 reply 0 retweets 3 likes -
Replying to @markcannon5 @TonyZador and
Okay, thanks. That's really the central question we're after here - how much prior knowledge is prewired from genomic info and how much is learned
1 reply 0 retweets 4 likes -
Replying to @WiringTheBrain @TonyZador and
No problem. To me it's purely information that builds a neural architecture that facilitates intelligence creation. Based on experience etc.
1 reply 0 retweets 1 like -
Replying to @markcannon5 @TonyZador and
That's the position Bengio and
@ylecun are arguing for - as few priors as possible and mainly for meta-learning rather than specific knowledge.@GaryMarcus argues for more prior knowledge pre-wired in from the genome2 replies 4 retweets 10 likes -
Replying to @WiringTheBrain @markcannon5 and
Free Recall Retweeted Free Recall
But does the genome really encode "knowledge?" The Nativists assume, yet never explain, how knowledge is directly encoded in the genome. This preformist assumption contradicts the self-organized and pattern-forming dynamics of real developmental systems:https://twitter.com/freerecall/status/1204039449371242497?s=19 …
Free Recall added,
Free Recall @freerecallWhat are the origins of cognition? Do infants possess innate knowledge? Or is knowledge actively constructed over development? Smith (1999) on the necessity of understanding the developmental process to explain the origins of knowledge: https://onlinelibrary.wiley.com/doi/abs/10.1111/1467-7687.00062 … pic.twitter.com/fAj2m5z5VV1 reply 5 retweets 7 likes -
Replying to @freerecall @WiringTheBrain and
it's a great question. In some cases, the genome encodes pretty specific stuff. Dams beavers build are hardwired And if a mouse that builds a short burrow is raised by long-burrowing moms, it still builds short burrows. Cool stuff from Hoekstra:https://hoekstra.oeb.harvard.edu/
6 replies 4 retweets 24 likes -
Replying to @TonyZador @freerecall and
How much of this can be via genome-encoded reward fxn? For mouse who likes short borrows “ugh, I hate wide open spaces” & “mmm, I’ve burrowed a just bit and now I’m so satisfied”. Vs. pre-coded program of actions. If so, still lots of learning involved, just w/ specific cost fxn.
3 replies 0 retweets 4 likes -
Replying to @AdamMarblestone @freerecall and
i dont understand this distinction. Hopi's expts show that genes determine whether the burrow is short or long. One mech to encode this in the genome involves a reward function on the length of the burrow (and a bit more). probably need more than "stop now" for birdspic.twitter.com/WspWDX3iAM
2 replies 0 retweets 1 like -
Replying to @TonyZador @freerecall and
It doesn’t contradict the genomic encoding at all. But it puts a different emphasis as far as the need to *additionally* have a quite powerful RL system operating, to get the right behavior. It suggests a different AI emphasis: meta learning or evolving very specific reward fxns.
2 replies 0 retweets 1 like
And to get birds, yeah, you need a whole sequence of super specific reward or loss functions to shape different parts of the brain at different times, and activating on cue from the environment. Very much like this maybe (in birds!):https://www.nature.com/articles/s41598-018-25112-5 …
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.