@themattsimpson Short version: unfriendly to whom? That question becomes ill-defined as t -> infinity
@themattsimpson The first claim is, I would argue (for related reasons), incoherent.
-
-
-
@themattsimpson But that's not my actual critique of value preservation. Actual critique: locked-down values must become incoherent.
-
@St_Rev @themattsimpson In the sense that today!you, hold desires that fiveyearold!you would find nonsense? Or deeper issue? -
@gattsuru @themattsimpson In that sense, plus the sense that today!you is not the same entity 5yearold!you is, exponentiated. -
@gattsuru @themattsimpson Imagine that you were forced by an autonomous non-sentient sub-AI module to obey your 5-year-old values. -
@gattsuru @themattsimpson Imagine that module was in your head and read your thoughts. Imagine that module was your personal torturer. -
@gattsuru @themattsimpson Now multiply it by, oh, a trillion. -
@gattsuru @themattsimpson Now consider that AI might have more to fear from MIRI than MIRI from AI.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
. Banned in Sweden. SubGenius, Zhuangist, white-hat troll. Defrocked mathematician. Brain problems.