This is what I've been doing for quite some time.
Recurrent Independent Mechanisms (RIMs)
https://arxiv.org/abs/1909.10893 , joint work with Alex Lamb, @shagunsodhani , @jordanhoffmann, @svlevine, @bschoelkopf and Yoshua Bengio. @MILAMontreal Here's a short summary:
-
Show this thread
Replying to @anirudhg9119 @shagunsodhani and
Prof. Anima Anandkumar Retweeted Prof. Anima Anandkumar
I think you will be interested in our work. We also have top-down feedback. Main difference: we have generative model and do approximate Bayesian inference, while being efficient. @YujiaHuangC @JamesGornet @ZhidingYu @doristsao @TanNguyen689 @dai_sh29https://twitter.com/AnimaAnandkumar/status/1286051266871795714?s=20 …
Prof. Anima Anandkumar added,
Prof. Anima Anandkumar @AnimaAnandkumar
Excited about our work on biologically inspired #NeuralNetwork with recurrent generative feedback. We show feedback is key to robustness, which current feedforward #NeuralNetwork lack. @YujiaHuangC @JamesGornet @dai_sh29 @ZhidingYu @TanNguyen689 @doristsao @Caltech @NVIDIAAI https://twitter.com/YujiaHuangC/status/1284016518594834434 …
Show this thread
2:50 PM - 22 Jul 2020
0 replies
2 retweets
6 likes
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.