thread on universally-quantified one to one mappings, which I still see as key bottleneck to future progress.https://twitter.com/GaryMarcus/status/1200637240214347776 …
-
-
I am not sure it is a general solution but building in operations over variables as NTM's do is the crux of what I have been arguing for. IIRC i mentioned that specific work approvingly in my Deep Learning Critical Appraisal and follow up on Medium (In Defense of Skepticism).
-
Yes, and FYI I think transformers with “relative position encoding” also arguably build in a syntactic/content independent variable binding mechanism https://arxiv.org/abs/1803.02155
- 1 more reply
New conversation -
-
-
to my mind the question has never been is the brain a neural network but rather what kind, and I have always argued that it must be a neural network that had operations over variables. even when I co-authored with you :)
- 1 more reply
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.