One way to describe intelligence is as "the ability to understand something from a partial description". How minimalist this description can be is a measure of intelligence.
Show this thread
-
AlphaZero's CNN has about 50M parameters (probably could be reduce 10X easily), still it captures an intuition that can beat the best experts on games and situations it has never seen. I would not call "intelligence", but it neither "just a query" of what was put in.
The AlphaZero CNN is not the same as a hashtable in the sense that it's capable of performing local generalization via interpolation (much like any parametric function that you fit to a manifold of data). It has non-zero generalization power. But that's still local generalization
-
-
This is what "a query of what was put in" means
-
Local or not, it still compresses crazy well: that knowledge is distilled into 50M parameters. I challenge anybody to design a lookup by ML or otherwise that does not uses deep learning (SGD for nonlinear deep function) and can perform even remotely as well.
- Show replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.