You can handle arbitrarily complex tasks with large parametric models trained with SGD. The problem is that doing it well requires a *dense sampling* of the input/output space you're learning, because the generalization power of these models is extremely weak. That's expensive. https://t.co/Lsc7zlQBFE
-
-
Again, a DL model requires a dense sampling of what it's doing. An intelligent agent (like a human) can do extreme generalization from little data. At this time, no one has any clue how that works. However, it may not necessarily be very complicated. Who knows...
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Insane amount of "experience" relative to what though ? Humans have genetically encoded skill from thousands of years worth of experience.
-
Hit the nail on the head there pal!
End of conversation
New conversation -
-
-
I think the biggest obstacle in the journey towards AGI is the lack of the consensus over the very definition of the “Intelligence”.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
I would say this is learning, not intelligence. If you do continuous learning, experience tends to infinity and learning, not intelligence, tends to zero.
-
Learning is directly proportional to intelligence,if you learnt something you can use it intelligently to solve problem
- Show replies
New conversation -
-
-
That's a pretty creative definition of intelligence. Source?
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Rt, as humans our skill is high, wth less exp..ex the mnist handwritten digits, we as humans can identify the digits with only abt few dozens of such images, at max..Cant rem how many times we saw these digits..few hund at max, whereas the Deep Learning needs 60k images
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Really like I = S/E. I think the ultimate feat of “generalization” would be general relativity, or thermodynamics... as few postulates used to explain or predict as broad as possible the amount of observations.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.