@St_Rev i think that if i can trust my future self then i can trust a duplicate of myself that i send to alpha centauri
@St_Rev do you believe no AI could reliably output those actions it believed to be optimal according to whatever criterion it cared about?
-
-
@tipsfromkatee Fiction isn't a reliable guide to actuality, but *all* talk of AI is fiction at this stage of the game, so... -
@St_Rev (i will probably try to engage with your argument more directly later)
End of conversation
New conversation -
-
-
@tipsfromkatee Anyway, Zelazny's _Today We Choose Faces_ is explicitly about the tension between value preservation and adaptation. -
@St_Rev@tipsfromkatee also that one by Ted chiang
End of conversation
New conversation -
-
-
@tipsfromkatee I find it likely that a true AI, choosing action based a weighted optimization procedure, will experience anguish based on...Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@tipsfromkatee ...a combination of goals not satisfied (optimization is about tradeoffs) and uncertainty (information is never perfect).Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@tipsfromkatee One particular aspect of LW thinking on AI that I'm extremely dubious of is the implicit or explicit belief that...Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@tipsfromkatee ...an AI will have full analytic knowledge and access to its own processes. This seems absurd to me.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@tipsfromkatee Simply because full analytic knowledge of system X is intrinsically a harder problem than actually being system X.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@tipsfromkatee I frequently feel like there's a weird open-the-box-with-the-crowbar-inside-the-box quality to LW arguments.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.