@GaryMarcus In your paper "DL: A Critical Appraisal" you mention a test you did for generalization during 1998. Its is still a good generalization test? Which is in your opinion the best generalization test for a AI?
-
-
Replying to @peremayol
There are (and should be) many different ways to assess generalization, but you might start with
@LakeBrenden’s updates to my late 90’s work. And look at@dileeplearning’s work on how DQN fails in tiny changes to Atari games.1 reply 2 retweets 8 likes -
Our blogs and papers highlight important aspects of generalization in vision, dynamics, and concept learning. https://www.vicarious.com/blog/
@vicariousai1 reply 1 retweet 9 likes -
Replying to @dileeplearning @GaryMarcus and
Do you consider at Vicarious that your tech & team have achieved generalization?
1 reply 0 retweets 0 likes -
Replying to @peremayol @GaryMarcus and
Of course not. We have good generalization in some limited settings. We think we have some of the right ingredients, but a lot more work remains.
4 replies 0 retweets 6 likes -
Replying to @dileeplearning @peremayol and
@MelMitchell1 compare the above to the screenshot from another company I shared recently ... just sayin’.1 reply 0 retweets 0 likes -
Replying to @GaryMarcus @dileeplearning and
Yup, I'm a big fan of
@dileeplearning and@vicariousai
Just to clarify from my previous posts: I wasn't saying that DeepMind doesn't hype their work; they absolutely do. I was just questioning your criticism that they don't have a successful deep RL *commercial product*.2 replies 0 retweets 2 likes -
Replying to @MelMitchell1 @dileeplearning and
They don’t have a successful commercial product that they have sold outside Alphabet. That’s just a fact AFAIK. But I very much read you as saying they weren’t making especially grand claims, which I think they are.
2 replies 0 retweets 0 likes -
Replying to @GaryMarcus @MelMitchell1 and
Why should they sell outside of Alphabet? The 'only made $100 million' line in your article was similarly baffling -- what's your point of comparison?
1 reply 0 retweets 0 likes
if they had a real product, why not? deepmind does have an applied/product division, and has had one maybe since inception. on the latter surely the notion of comparing revenue with costs didn’t originate me.
-
-
Replying to @GaryMarcus @MelMitchell1 and
Internal products are still products, $100M is noteworthy given the basic research focus. The notion of using revenue/costs to assess scientific merit is rather unique to you. What lab is doing better by this metric? Has it historically been a precursor to larger innovation?
2 replies 0 retweets 3 likes -
Replying to @Zergylord @MelMitchell1 and
@Zergylord please reread; i absolutely did not judge the scientific value of DRL on $revenue. multiple paragraphs pointing out other limits, before economic analysis.1 reply 0 retweets 0 likes - 1 more reply
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.