Oh, so now AlphaGo is a hybrid? :) but yes I like a lot of that work and have advocated for some of it over time. I totally agree that DRL is not the only emphasis at DM; it’s just the largest (from what I can tell) and my least favorite and most visible, wrapped in one.
-
-
Replying to @GaryMarcus @sir_deenicus
It's what you'd consider a hybrid. To RL folks the jump from DQN to MCTS doesn't change fields, so "hybrid" sounds weird.
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
Its not weird, it’s what (in conjunction) with RL makes it work. You have drunk the KoolAid if you ignore this.
2 replies 0 retweets 1 like -
Replying to @GaryMarcus @sir_deenicus
MCTS is literally in RL 101 textbooks. The tree structure of MDPs is inherent in their temporal structure and core to RL. I'm sure it reminds you of Chomsky, parse trees, grammars, and that's fine, but not invoking them isn't "drinking the KoolAid", it's understanding the field.
1 reply 0 retweets 1 like -
Replying to @Zergylord @sir_deenicus
Assimiling DQN and MCS + DRL as if they are same, without talking about why different design choices were made is misleading.
2 replies 0 retweets 0 likes -
Replying to @GaryMarcus @sir_deenicus
That's never happened. They are different algorithms in the same field (Seriously, look at RL textbooks). As my previous quote showed, they were quite up front with the different design choices.
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
And yet
@sir_deenicus and I had to remind that you Alpha* even was a hybrid model...1 reply 0 retweets 1 like -
Replying to @GaryMarcus @sir_deenicus
Please reread the thread. I was explaining that *you* thought of them that way, and that was odd given *your* argument re DRL. Come on Gary, I'm trying to tweet in good faith, try to look for the intended interpretation.
1 reply 0 retweets 1 like -
Replying to @Zergylord @sir_deenicus
this part of the thread started with you saying that Watson is a “ quite a bit closer to the Gary's cognitive hybrid systems approach than anything out of DeepMind”, which i felt minimized the extent to which DM actually relies on hybrids.
1 reply 0 retweets 0 likes -
Replying to @GaryMarcus @sir_deenicus
Watson is much closer to the sort of system you have in mind. I don't consider AlphaGo a hybrid system of this sort. No DeepMinder has ever equated AlphaGo with DQN. They are different RL algorithms in their respective subfields of model-based and model-free DRL.
1 reply 0 retweets 0 likes
Alpha* is a better module, Watson is a better attempt at integrating a wide range of representations. neither are the answer.
-
-
Or maybe both together are the answer
1 reply 0 retweets 0 likes -
I want to emphasize here again that MCTS is definitely a subset of discrete non-deterministic search algorithms pioneered by "symbolic AI". As I said in another thread, you can easily implement MCTS in terms of a continuation monad interpreted over probabilistic semantics.
1 reply 0 retweets 3 likes - 1 more reply
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.