Most AI apocalypse scenarios seem predicated on the idea that the AI will be murderously insane.
But what if it's just better than you?
3
11
14
Conversation
Replying to
Imagine if you generate a sufficiently powerful AI and its reaction is not murder, but "oh my god you poor, lost things! let me help you."
1
Replying to
This of course assumes a kind of human-esque moral sentiment, but the point is that we are not so special, not so good, not so nice.
1
Replying to
And if we create a being more powerful than us, for example in an attempt to solve some major problem, and it develops its own agency...
1
Replying to
Chances are good it would try to optimize for solving our problems, possibly better than we could even imagine. Would people accept that?
Replying to
It will act / evolve according to its programming; getting a failsafe Friendly AI right on the first go is a Very Hard Problem
Replying to
The possibility space of intelligence is vast, there's no reason to assume a random intelligence would care about us
1
So it would have to be explicitly designed for that. I suggest reading up on the Friendly AI problem, paperclip maximizers etc
1
Show replies