"What works for Go may not work for the challenging problems that DeepMind aspires to solve with AI, like cancer and clean energy. IBM learned this the hard way" Picks the only large scale symbolic AI project to illustrate the potential shortcomings of DRL... https://twitter.com/GaryMarcus/status/1161690752524550144 …pic.twitter.com/3lbLcRQ0kz
-
-
Replying to @Zergylord
don’t understand, sorry. largest symbolic project you refer to is?
2 replies 0 retweets 1 like -
Replying to @GaryMarcus
Watson. The only commonality between Watson and AlphaGo is the AI moniker, so it feels like an odd comparison
1 reply 0 retweets 0 likes -
Replying to @Zergylord @GaryMarcus
This is incorrect in several ways though. First, Watson seems to have been an everything and the kitchen sink approach. They used logistic regression, rule based, lexical databases, information retrieval, grammar based parsers, SVM based relation extractors etc.
3 replies 0 retweets 2 likes -
Part of the etc. is their heavy use of simulations to fit parameters for their strategy modules. I'll have to recheck but I recall the use of bayesian methods, reinforcement learning, Neural networks and monte carlo search in the game strategies paper: https://ieeexplore.ieee.org/document/6177733 …
3 replies 0 retweets 3 likes -
Replying to @sir_deenicus @GaryMarcus
I'm sure they did lots of things to make it work. It's still the most symbolic and least DRL system coming out of any modern research lab. It's quite a bit closer to the Gary's cognitive hybrid systems approach than anything out of DeepMind.
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
hype aside, alphago is a hybrid, with a monte carlo tree sim backbone that traversed trees out of symbol CS 101, alongside the DRL.
1 reply 0 retweets 1 like -
Replying to @GaryMarcus @sir_deenicus
That's an odd argument to make since you also claim DeepMind relies too much on DRL.
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
Both can be & are true. Really telling to me is that DRL on its own worked for Atari games but not Go— and that DM’s spin on Go really downplayed the hybrid aspect that was essential to its success. (It was also apparently necessary to build in the rules for Go, unlike Atari.)
3 replies 0 retweets 0 likes -
You can't play a game if you don't know the rules! Of course the rules of Go is an input to this program. Are you saying that AlphaZero also needs to formulate the rules of Go?
2 replies 0 retweets 1 like
Breakout and space invader didn’t require rules to be built in.
-
-
Yes, the DRL method learned the rules of the game. This is typical for video games. I don't know of anyone who has done it, but I am sure you can use a RL methods (No DL required) to learn the rules of Go.
0 replies 0 retweets 0 likesThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.