Referring to deep learning as just being good for "perception" really strains credulity. Chess has historically been a prototypical exercise in reasoning, but since variables weren't involved in it's mastery, I guess it's perception now?https://twitter.com/GaryMarcus/status/1068897657530138629 …
-
-
Replying to @Zergylord
also you are ignoring all the work the monte carlo tree search and related infrastructure contributed, apparently attributing the entirely solution to deep learning, which would be inaccurate
1 reply 0 retweets 3 likes -
Replying to @GaryMarcus
Not at all, I'm quite the fan of MCTS, but it isn't a variable. The convolutions were a key bit of prior knowledge, but also weren't variables. You claimed that symbolic manipulation would be required to move past perception, but I fail to see any symbolic representations here.
3 replies 0 retweets 1 like -
-
Replying to @GaryMarcus
MCTS is a search procedure, whereas you seem to be mistaking it for tree-structured representations. That they both have "tree" in the name seems besides the point.
1 reply 0 retweets 0 likes -
Replying to @Zergylord
the procedure operates over variables, with lots of variable binding taking place. that’s what matters. (and as it happens at least in the original Nature paper parts of the tree itself were encoded, if i recall correctly.)
1 reply 0 retweets 0 likes -
Replying to @GaryMarcus
That is a very liberal definition of variable binding. That would encompass all planning procedures (e.g. s_{t+n} is bound to the state predicted in n steps). If wading into model-based RL is all you wanted, then every DRL researcher is already on board. Mission accomplished?
3 replies 0 retweets 1 like -
Replying to @Zergylord
it is partly an implementational question; some functions can be computed in different ways, some w recourse to variables others not. too long for twitter, see chapter 2&3 of algebraic mind
1 reply 0 retweets 0 likes -
Replying to @GaryMarcus @Zergylord
a challenge for you if you wanted to pursue an ant-symbol position would be to capture the power of MCTS using a neural net that didn’t just map onto code like this: https://jeffbradberry.com/posts/2015/09/intro-to-monte-carlo-tree-search/ …
2 replies 0 retweets 0 likes
in the case of recognizing images, that’s easy to do (viz building a perceptron that is not a transparent implementation of an obvious symbolic algorithm) ; in the case of MCTS harder. good research problem.
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.