Here’s what I have been saying since 2001: “Neural networks have to be supplemented with the key components of symbol manipulation in order to capture the compositionality of language and thought.” Agree or disagree, @ylecun? At our debate you said “diagree”. Your stance now?https://twitter.com/ylecun/status/1065298686413078528 …
-
Still trying to understand - when you say "components" / "machinery" do you refer only to mechanisms placed there by the designers? Or does your claim entail mechanisms that arise emergently: hard for human observers to find / point to, but demonstrably real if we did find them?
What matters is not designer intention, but whether there is a perfect mapping. This is something I go over in detail in Chapter 3 of The Algebraic Mind, showing examples of cases where some models map perfectly and some don’t, indepedently of what creators assert.