[thread] A fascinating Turing award lecture. What's intrigues me is that Yoshua Bengio (see from here https://youtu.be/llGG62fNN64?t=2448 …) believes in compositionality, but not in a combination of good old search-based approaches with neural networks.
-
Show this thread
-
Everything should be a pure neural network processing, where search is done via some smart attention-based process. This is how--Yoshua Bengio argues--human think. Well, for one thing, we don't know how this happens. For another, a lot of automation/mechanization processes...
1 reply 1 retweet 5 likesShow this thread -
Do not try to mimic how animals/people think or move. One could insist that cars may need to walk and jump (and for rough terrain it's a must), but in most cases we can build roads and put cars on wheels. For many years to come this is likely gonna be an optimal solution.
2 replies 0 retweets 8 likesShow this thread -
Replying to @srchvrs
I would tend to agree with that spirit. You want symbol manipulation but these symbols need to emerge as attractors in highly recurrent neural net. For one, because we have no idea what these symbols should represent at the lower level of cognition.
1 reply 0 retweets 1 like -
Replying to @filippie509 @srchvrs
But that is almost entirely perpendicular to a question of whether hybrid GOAI and deep learning could bring useful applications. I think the answer to that is yes, but at the same time it is not a road towards solving AI.
1 reply 0 retweets 1 like -
-
Replying to @srchvrs
Yup. But they seems to be despised by some of these deep thinkers who think everything should be end-to-end deep net or otherwise it is in some way contaminated and poisonous. I think that is what triggers
@GaryMarcus1 reply 0 retweets 2 likes -
Replying to @filippie509 @GaryMarcus
Actually Gary Marcus seems to agree with J. Bengio that GOAFI can't be put on top if neural nets. Frankly speaking I have no strong opinion about this. Clearly it can work somehow but results can be suboptimal.
2 replies 0 retweets 0 likes -
Replying to @srchvrs @GaryMarcus
I think there is nothing wrong with: - feeding deep nets with engineered features - using output of a deep net in some expert system which e.g. checks the consistency of answers. Self driving car prototypes use all of the above and more.
2 replies 1 retweet 6 likes
agree; just think Bengio painted me into a corner that i never advocated. all those things are fine, but unlikely in themselves to solve our problems with common sense, etc
-
-
Replying to @GaryMarcus @srchvrs
Oh yeah, I think we both violently agree on that.
1 reply 0 retweets 1 like - 7 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.