One way to describe intelligence is as "the ability to understand something from a partial description". How minimalist this description can be is a measure of intelligence.
Show this thread
-
The AlphaZero CNN is not the same as a hashtable in the sense that it's capable of performing local generalization via interpolation (much like any parametric function that you fit to a manifold of data). It has non-zero generalization power. But that's still local generalization
-
-
Local or not, it still compresses crazy well: that knowledge is distilled into 50M parameters. I challenge anybody to design a lookup by ML or otherwise that does not uses deep learning (SGD for nonlinear deep function) and can perform even remotely as well.
-
With 16 bits / parameter (x 5M tot) that would be about 10 MB, which is still a fair amount. You can write a chess AI that takes 100X less space and defeats most humans. So perhaps, humans are just not well suited to these games. One observation is the NNs might be
- Show replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.