Watson. The only commonality between Watson and AlphaGo is the AI moniker, so it feels like an odd comparison
-
-
Replying to @Zergylord @GaryMarcus
This is incorrect in several ways though. First, Watson seems to have been an everything and the kitchen sink approach. They used logistic regression, rule based, lexical databases, information retrieval, grammar based parsers, SVM based relation extractors etc.
3 replies 0 retweets 2 likes -
Part of the etc. is their heavy use of simulations to fit parameters for their strategy modules. I'll have to recheck but I recall the use of bayesian methods, reinforcement learning, Neural networks and monte carlo search in the game strategies paper: https://ieeexplore.ieee.org/document/6177733 …
3 replies 0 retweets 3 likes -
Replying to @sir_deenicus @GaryMarcus
I'm sure they did lots of things to make it work. It's still the most symbolic and least DRL system coming out of any modern research lab. It's quite a bit closer to the Gary's cognitive hybrid systems approach than anything out of DeepMind.
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
hype aside, alphago is a hybrid, with a monte carlo tree sim backbone that traversed trees out of symbol CS 101, alongside the DRL.
1 reply 0 retweets 1 like -
Replying to @GaryMarcus @sir_deenicus
That's an odd argument to make since you also claim DeepMind relies too much on DRL.
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
Both can be & are true. Really telling to me is that DRL on its own worked for Atari games but not Go— and that DM’s spin on Go really downplayed the hybrid aspect that was essential to its success. (It was also apparently necessary to build in the rules for Go, unlike Atari.)
3 replies 0 retweets 0 likes -
Replying to @GaryMarcus @sir_deenicus
So we build hybrid systems but are also too reliant on DRL? How can both of those be true?
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
It’s question of emphasis, in part, but if I were running your ship I would spend more time exploring principled ways of building hybrids, and more kinds of of hybrids, and more time on on open-ended problems.
1 reply 0 retweets 0 likes -
Replying to @GaryMarcus @sir_deenicus
Other than Neural Turing Machines, AlphaGo, GraphNets, GQN, SPIRAL, etc? I'm sure you'd run things differently, but this is a far cry from the DRL centric narrative of the Wired article.
1 reply 0 retweets 1 like
Oh, so now AlphaGo is a hybrid? :) but yes I like a lot of that work and have advocated for some of it over time. I totally agree that DRL is not the only emphasis at DM; it’s just the largest (from what I can tell) and my least favorite and most visible, wrapped in one.
-
-
Replying to @GaryMarcus @sir_deenicus
It's what you'd consider a hybrid. To RL folks the jump from DQN to MCTS doesn't change fields, so "hybrid" sounds weird.
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
Its not weird, it’s what (in conjunction) with RL makes it work. You have drunk the KoolAid if you ignore this.
2 replies 0 retweets 1 like - 11 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.