right: the modem machine learning take on innateness is to pretrain a model on a massive corpus for a specific language. but is that the right *kind* of innateness? certainly it’s not what humans are born with.https://twitter.com/martingoodson/status/1193188416189583360 …
-
That’s actually a fantastic question: what is the minimum amount of innate knowledge and models to give a multi-purpose agent? We should be talking more about knowledge representation
i made a specific proposal here: https://arxiv.org/abs/1801.05667 in the list of 10 elements, which I originally proposed at my debate with @ylecun (which you can find on youtube):pic.twitter.com/tngmg5ImmB
