right: the modem machine learning take on innateness is to pretrain a model on a massive corpus for a specific language. but is that the right *kind* of innateness? certainly it’s not what humans are born with.https://twitter.com/martingoodson/status/1193188416189583360 …
-
Humans are born with millions of years of evolution. Since replicating that process in a literal way would be impractical, any kind of innateness we give AI won't be the sort that humans are born with.
this is like arguing that airplanes will never fly. surely we can reverse engineer some evolution’s endproducts and take hints from those in order to improve our systems.
-
-
Not trying to say it's impossible. Merely that "pretrained DL isn't the human kind of innateness" is only a priori true in that rather literal sense. IMHO In terms of the products of the evolution, it's probably a step in the right direction.
-
see my pinned tweet; i don’t think it is working. and per my 2001 arguments on extrapolation i wouldn’t expect it to
- 1 more reply
New conversation -
-
-
This seems indeed very reasonable. And while evolutionary context likely matters, not all may be equally relevant for the best human-like innate AI architecture? Eg a plane can fly very well but doesn’t carbon copy a bird’s way of flying.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.