What allergy to innateness? Isn't basically all of computer vision now based on pre-trained ResNets, with *innate* low-level feature detectors?
-
-
-
Replying to @GaryMarcus
Thank you for the reference. It's not a fair characterisation that AI has an 'allergy to innateness' or 'an unthinking commitment to relearning everything from scratch'. Innate cognitive capability comes from things like pre-trained ResNets or language models.
1 reply 1 retweet 2 likes -
Replying to @martingoodson
i would refer you to my arxiv 2018 on innateness
1 reply 0 retweets 0 likes -
Replying to @GaryMarcus
It's an 18 page article. Could you perhaps point me to a relevant page, paragraph, idea or argument? After a quick read it's not obvious that this article has definitively closed off any further examination of this question.
1 reply 0 retweets 2 likes -
Replying to @martingoodson
focus on the list of ten primitives for a start
1 reply 0 retweets 0 likes -
Replying to @GaryMarcus @martingoodson
my argument is that we should look at things like that; prettainrd nets aren’t getting us to deep understanding. if you really want to understand the issues you will have to do some reading. it’s not going to come from twitter
1 reply 0 retweets 0 likes -
Replying to @GaryMarcus
Thank you for the advice - I will be sure to seek other sources of knowledge. My point is that using pre-trained nets *is* to use 'innate' knowledge. Our neural networks are also pre-trained, by evolution. I'm open to hearing an argument against this but I haven't heard one yet.
1 reply 0 retweets 1 like -
Replying to @martingoodson
Gary Marcus Retweeted Gary Marcus
argument starts here: we really aren’t getting to anything like deep understanding using pretrained models.https://twitter.com/garymarcus/status/1192136091039649797?s=21 …
Gary Marcus added,
Gary Marcus @GaryMarcusfact: progress on benchmarks has NOT thus far translated into progress on dialog & story understanding. NO current AI can read a story/article or follow a dialog & build a mental model of what has taken place questions we should be asking: - why not? - what else should we do?Show this thread1 reply 0 retweets 0 likes -
Replying to @GaryMarcus
Well that's not an argument that AI is 'allergic to innateness', it's an argument that we haven't yet figured out how to produce the right kind of innateness. This 'allergic' thing seems to be a straw man.
2 replies 0 retweets 2 likes
allergic in that sense even when they have innateness they downplay it Rubik’s cube system for example included an innate symbolic solver that was downplayed solver; alphago’s title about mastering go without human knowledge was misleading etc. or see marcus-lecun debate
-
-
Replying to @GaryMarcus
Not sure about that. Ever read this paper?pic.twitter.com/hCnMdEunFH
0 replies 0 retweets 0 likesThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.