Whatever Super AI we end up with, it probably won't be a product of natural selection and so won't have an engrained instinct to reproduce.
@swombat If it's so smart, surely it can make up its own mind about its utility function.
-
-
@paulbaumgart That’s one of the hopes. And it might realise that the quickest way to maximise it is to cheat and edit it.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@paulbaumgart All sorts of possible scenarios. The point is, we don’t have the foggiest what will happen in practice.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@paulbaumgart Which I guess is pretty scary since this is a potential extinction-level event for the whole human race…Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.