Moravec’s paradox is really a statement about closed vs open worlds and intelligence-based versus survival-based reward functions. Open-world rewards are illegible because survival is illegible. Persistence of situated subjective agent identity https://en.m.wikipedia.org/wiki/Moravec's_paradox …
What would it mean for DeepMind type AIs to solve “survival” problems? I don’t think it would be that hard. In fact very simple computer viruses arguably already survive in the wild if they persist past X=patch/update events by hiding in computers with sloppy security policies
-
-
I think the problem is we humans don’t know how to think about true survival competitions. It’s closer to battling cancer or fighting epidemics of mutating viruses than a battle of intelligences. There is no end, and no “point” being proved. Just living to fight another day.
Show this thread -
Asking “can humans beat AIs?” in an open world context is like asking, “can humans beat the common cold?” We can manage and contain it, but cold viruses already represent a non-human general intelligence that can survive us.
Show this thread -
Confusion in interpreting what AIs have been achieving is often due to the fact that intelligence and survivability are coupled but not the same thing. When intelligence can be made legible (human brains as opposed to ant swarms) we get tempted into confusing it for survivability
Show this thread -
You might say that any construction of “intelligence” is like retrieval habits from a compressed map of a particular history of survival. A legibilization of the map results in a formalization. “Grid”: map of NY : NY :: IQ : intelligence : survival.
Show this thread -
Intelligence correlates with survival positively when the map is more correct than not, especially where mortal threats are concerned. The “skill” aspect of intelligence is secondary. It’s just accuracy of map recall. And remember the map is a metaphor here.
Show this thread -
If you eliminate “future is like the past” presumption, intelligence and survival become decoupled. Or worse, negatively coupled. If you try efficient Manhattan grid navigation in the right kind of perversely laid-out city, even a random walk will out-survive you.
Show this thread
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.