Most AI apocalypse scenarios seem predicated on the idea that the AI will be murderously insane.
But what if it's just better than you?
3
11
14
Conversation
Replying to
Imagine if you generate a sufficiently powerful AI and its reaction is not murder, but "oh my god you poor, lost things! let me help you."
1
Replying to
This of course assumes a kind of human-esque moral sentiment, but the point is that we are not so special, not so good, not so nice.
1
Replying to
And if we create a being more powerful than us, for example in an attempt to solve some major problem, and it develops its own agency...
Replying to
Chances are good it would try to optimize for solving our problems, possibly better than we could even imagine. Would people accept that?
2
Replying to
It will act / evolve according to its programming; getting a failsafe Friendly AI right on the first go is a Very Hard Problem