All generalization must by definition come from some form of abstraction. The abstractions that can be learned by DL models (often reflections of human abstractions injected via labels) are fairly weak and shallow, which is why DL is only capable of local generalization.
-
-
Show this thread
-
If AI today isn't capable of autonomous abstraction, it isn't because it's a particularly hard technical problem. Rather, it's a subtle conceptual problem. It doesn't seem like many people are looking at it. You can't produce the right answers if you're asking the wrong questions
Show this thread -
AI today is to human intelligence what the phonograph was to human musicians. Superficially, it may seem like it has a comparable output & is ready to replace musicians (which was a real fear back then). But it has radically different capabilities: it's merely a recording device.
Show this thread -
Don't confuse music creation with sound recording. Musicians are the origin of music. Unlike a phonograph, they can play a never-played before score, or write never-heard before music. Or take up a new instrument. Or invent a new musical genre.
Show this thread -
Historically, we went technology to record sound to technology capable of helping with music production and creation. New, more powerful tools. Eventually, we will see open-ended autonomous music creation. This will be the trajectory of AI as well.
Show this thread -
From recorded abstraction, to cognitive augmentation tools, to autonomous abstraction.
Show this thread
End of conversation
New conversation -
-
-
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
This Tweet is unavailable.
- End of conversation
-
-
-
I think Capital-C complexity is also important here. The continuous ability to innovate abstractions autonomously (and in reaction to a human social context). In that sense, "intelligence" has always been the wrong question. Humanity is the special property, not intelligence.
-
And the ability to extrapolate sensibly from few samples. It is one thing to recognize a dog after seeing 1 million labeled examples, and another to recognize it after seeing 10 maybe-labeled instances. And the ability to leverage past understanding of the world for new tasks.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.

