Great thread. My personal take: this “non-visual” activity reflects the internal generative model of the animal, i.e. the visual cortex is sampling from a distribution conditioned on motor activity.https://twitter.com/marius10p/status/988069221941874688 …
-
0:20Show this thread -
Replying to @tyrell_turing
The neurons are representing actions, not the sensory consequences of those actions. The latter would have looked very different. For example in darkness, the sensory consequences of movement are still darkness, so there should be no response! Read the paper for the fine details.
2 replies 0 retweets 5 likes -
Replying to @marius10p @tyrell_turing
Not sure this makes sense, in darkness the sensory consequences of movement are proprioception.
1 reply 0 retweets 4 likes -
Replying to @AdamHantman @tyrell_turing
@tyrell_turing is talking about visual predictive coding in V11 reply 0 retweets 0 likes -
Replying to @marius10p @tyrell_turing
How do you know it is predictive coding in v1 and not proprioception in v1
1 reply 0 retweets 4 likes -
or vestibular-driven? c.f. cat primary visual cortex (after caudal medulla section) https://ac.els-cdn.com/S0079612308639333/1-s2.0-S0079612308639333-main.pdf?_tid=37a50152-00e9-4dae-b32d-e92884942148&acdnat=1524574503_37b2d32e121fae92aee07edbc2b39ff1 …pic.twitter.com/U4eOCOKzYk
1 reply 0 retweets 5 likes -
All good hypotheses. What I think doesn't work is predictive coding of visual inputs, which is a popular theory in neuroscience.
1 reply 0 retweets 6 likes -
1/ I’ll have more to say after I read the paper, but want to clarify that I don’t necessarily advocate for Rao & Ballard predictive coding here.
2 replies 0 retweets 1 like -
Replying to @tyrell_turing @marius10p and
2/ My intuition, though, is that motor/vestibular/proprioceptive input to V1 would provide conditioning variables for a generative model of visual input.
1 reply 0 retweets 2 likes -
Replying to @tyrell_turing @marius10p and
Yeah! See "efference copy" on left hand side of below picture from https://www.youtube.com/watch?v=P0yVuoATjzs … for an example, building from their earlier paper https://arxiv.org/abs/1511.06380 pic.twitter.com/fF1BzhNGGR
1 reply 1 retweet 7 likes
Or the fact that the "action" from time t-1 is both encoded and decoded in from https://arxiv.org/abs/1803.10760 pic.twitter.com/kWDnvjg3fo
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.