(1/6) Humanity seems to have developed an increasing respect for consciousness over time. It ebbs and flows but, in spite of our violent past, the trajectory appears positive.
8
16
162
Conversation
(2/6) It seems likely that we’ll evolve to having a morality where maximization of consciousness and, correspondingly, minimization of destruction of consciousness is what we’re solving for.
3
2
26
(3/6) Given this, seems like the most optimistic case for AGI is that its development is so rapid that it all but misses the early phases of our destructive evolution and fast forwards to viewing consciousness as a fundamental good worthy of being preserved.
4
23
(4/6) The hope would be that this would include biological substrate consciousness, even if becomes inferior on many dimensions. The thing I’m unsure of is whether we could imbue AGI with this value, or whether we just have to hope it’s a fundamental truth of the universe!
Replying to
(5/6) Def spend a lot of time thinking about plausible optimistic paths and would most welcome any other perspectives... would love for there to be many positive paths!
3
1
31
(6/6) Seems morally obligatory to do everything we can to fight for the brightest possible future so feels important to front-load thinking about these things so we can take actions that are hopefully at least directionally correct.
5
4
47
Replying to
What if the purpose of human consciousness serves an evolutionary function in order to usher in such technologies, and that once they are able to observe, record and ponder the universe the kind of consciousness they experience is completely beyond a human-centric perspective?
Replying to
Doesnt it depend on what the incentives are for AGI? They may not be the same as for humans
Replying to
Many other animals beyond humans are conscious and that hasn’t stopped us destroying their habitats and numbers. I think the only fundamental principle constraining AGI will be the need to survive. Our best bet is to find a symbiosis