Conversation

You’re unable to view this Tweet because this account owner limits who can view their Tweets. Learn more
I mean, eventually the assumption is that people will upload their minds and *be* AIs, right? Seems absurd to keep AI centralized forever.
3
5
Quote Tweet
Replying to @CineraVerinia
A democratized government is not one in which every citizen who wants to can wield the powers of government. Similarly, “democratized AGI” should not be understood as everyone having access to AGI capabilities…
1
2
Quote Tweet
Replying to @CineraVerinia
The AGI strategic landscape we would wish for is centralized institution(s) with competent and wise leadership who act as civil servants of the people, representing their equally-weighted legitimate longterm best interests. (I think that’s also the core aspiration of democracy.)
1
1
Post-acute-risk-period, I think there ought to be a “night watchman Singleton”: an AGI which technically satisfies Bostrom’s definition of a Singleton, but which does no more and no less than ensuring a baseline level of security for its citizens (which may include humans & AIs).
If and only if a night-watchman singleton is in place, then everyone can have their own AI if they want. The night-watchman will ensure they can’t go to war. The price of this is that if the night-watchman ever suffers a robustness failure it’s game over (as with any Singleton).
2
6
Show replies