“I’m not saying I want to forget deep learning... But we need to be able to extend it to do things like reasoning, learning causality, and exploring the world .” - Yoshua Bengio, not unlike what I have been saying since 2012 in The New Yorker.https://www.technologyreview.com/s/612434/one-of-the-fathers-of-ai-is-worried-about-its-future/ …
-
Show this thread
-
Replying to @GaryMarcus
Ideally, you'd be saying this through NeurIPS submissions rather than New Yorker articles. A lot of the push-back you're getting right now is due to the perception that you haven't been using the appropriate channels to influence the field.
3 replies 0 retweets 7 likes -
This Tweet is unavailable.
-
They also publish actual research though. I'm not saying Marcus nor Google/DeepMind/OpenAI/FAIR shouldn't talk to the media or the general public. But its hard to listen to complaints that the field isn't changing when you're not directly engaging with it.
1 reply 0 retweets 2 likes -
This Tweet is unavailable.
-
If you want to change the direction of an academic field (he does), then you should be speaking the language of academics. Present novel results using symbolic systems. DL has been incorporating more forms of prior knowledge, its unclear to me that it needs to correct course now.
1 reply 0 retweets 2 likes -
Replying to @Zergylord
Addressed this yesterday; see tweet re why I don’t build AGI in a day.
1 reply 0 retweets 0 likes -
Replying to @GaryMarcus
Not asking for AGI in a day, just a concrete algorithm/model/system. Its easy for you to poke holes in existing DL systems, but its currently impossible for us to poke holes in yours. I'd be happy to add a symbolic baseline to my next paper, but one has to exist.
1 reply 0 retweets 5 likes -
Replying to @Zergylord
I actually think benchmarks are to some degree the wrong way forward, and have said that for two decades. People need to take a step back, and reflect on where things stand, rather than rushing into the next bakeoff.
1 reply 0 retweets 5 likes -
Replying to @GaryMarcus
How do we "reflect on where things stand" without empirical measures? I mean proofs would work, but don't seem nearly sufficient.
1 reply 0 retweets 3 likes
you have start by looking hard at failures, and what causes them. i documented some, now we have many adversarial cases, and things that are buried in footnotes like BERT’s failure on Winograd schemas
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.