It’s question of emphasis, in part, but if I were running your ship I would spend more time exploring principled ways of building hybrids, and more kinds of of hybrids, and more time on on open-ended problems.
-
-
Replying to @GaryMarcus @sir_deenicus
Other than Neural Turing Machines, AlphaGo, GraphNets, GQN, SPIRAL, etc? I'm sure you'd run things differently, but this is a far cry from the DRL centric narrative of the Wired article.
1 reply 0 retweets 1 like -
Replying to @Zergylord @sir_deenicus
Oh, so now AlphaGo is a hybrid? :) but yes I like a lot of that work and have advocated for some of it over time. I totally agree that DRL is not the only emphasis at DM; it’s just the largest (from what I can tell) and my least favorite and most visible, wrapped in one.
1 reply 0 retweets 1 like -
Replying to @GaryMarcus @sir_deenicus
It's what you'd consider a hybrid. To RL folks the jump from DQN to MCTS doesn't change fields, so "hybrid" sounds weird.
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
Its not weird, it’s what (in conjunction) with RL makes it work. You have drunk the KoolAid if you ignore this.
2 replies 0 retweets 1 like -
Replying to @GaryMarcus @sir_deenicus
Seriously, here is an RL course lecture (pre-AlphaGo) where MCTS is covered. Its not some separate thing borrowed from some symbolic field, its core to RL.https://youtu.be/ItMutbeOHtc
1 reply 0 retweets 0 likes -
Replying to @Zergylord @sir_deenicus
your dichotomy is false. MCTS is core to RL, but it relies on symbolic computation. famous folk like
@geoffreyhinton going around saying we don’t need symbol manipulation , but you can’t have MCTS if you give up symbol-manipulation. rhetoric and reality don’t line up.3 replies 0 retweets 1 like -
If MCTS is symbol manipulation, then so is the whole of RL. In which case, you've already won b/c we're doing RL. Using different definitions from the rest of the field isn't terribly fruitful though.
2 replies 0 retweets 1 like -
why don’t you ask Geoff what he means, or refer to my lengthy not for twitter discussion in algebraic mind
2 replies 0 retweets 0 likes -
And I've got your book, any section in particular address there symbolic nature of MCTS/RL?
1 reply 0 retweets 1 like
no my directly. but chapters 2 and 3 explain why being clear about symbol-manipulation is important, and what is and is not important about this distinction. i would rather not continue this discussion in sound bite way, when the distinctions are subtle.
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.