There aren't many clear examples of successive changes in tuning between layers outside of primary visual cortexpic.twitter.com/2WBvcnJvQ5
You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
There aren't many clear examples of successive changes in tuning between layers outside of primary visual cortexpic.twitter.com/2WBvcnJvQ5
Maybe we shouldn't think of layers as the unit performing the computation but rather a set of cell types spread across multiple layers?pic.twitter.com/YBdRlVgY3C
Corollary: if we are trying to understand what a "Deep Network" is doing, should we understand it at a given LAYER or ACROSS MULTIPLE LAYERS?
Say it with me: nothing in a neural network makes sense except in light of the behavior it producespic.twitter.com/aC3D35at88
So far the answer is no but we're still optimistic. Is my summary accurate?
what I got from this is that a layer may be the wrong unit to be focusing on
I'm not convinced. What they didn't discuss is how layers are important during circuit formation. Even if they are of minor relevance for processing, they may be vital for development. At least there is a lot of evidence which suggests at least some relevance.
yeah our focus was definitely on function relevant to sensation/behavior at the timescale of milliseconds to seconds. within that domain, I agree with adam and sebastian.
@qubiclql fair point, we didn't think about that too much. you might find this paper https://www.frontiersin.org/articles/10.3389/fnana.2017.00054/full … to be food for thought - they consider the possibility that layers are "a structural epiphenomenon caused by developmental dynamics"
I think it's unlikely that that is the case, but I think at this time it can't be ruled out - which, if you think about it, is pretty remarkable given how much this part of the brain has been studied
Really sleep deprived atm but will try to respond to some of this now, and maybe extend clarify tom if needed
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.