Conversation

Replying to
I think one of this things people miss is that the next generation is already super comfortable with predicted & automated way in which their tasks happen - play or work. Like how the generation before us couldn't fathom cellphone or how we can't fathom facial recognition today
2
Replying to and
Brightest possible? We figure out a good, stable way to train a powerful general purpose agent to predict what will make us happy and satisfied, and set one loose. It improves its own code and hardware, and eventually becomes arbitrarily powerful. Paradise ensues.
2
1
Lots of obvious pitfalls here. You need to be really sure it's pursuing the right goal before you turn it loose - but you can't take too long once the technology is widely available, or else you'll be beaten to the punch by someone else doing a worse job.
1
Replying to and
Immortality; control over nature; access to resources of the observable Universe; pondering how to reach inaccessible regions. Maybe indirect normativity to have Superintelligence help us get there;Humanity rising to current global challenges to demonstrate we're worth preserving
1
Replying to
Time becomes irrelevant because the AI can solve disease/death. Means we can explore the universe by slowly spreading out. Alternatively, we could simulate millions of different lives for ourselves where we get the chance to really understand what it’s like to be born in ...
1
4
contexts. Like growing up as a farmer, or growing up as a different sex/ethnicity. Or living in a different time period. I don’t think I can score any bonus points because I think we would have to just get extremely lucky to get it right. I can’t think of better ideas than put...
1
2
Show replies
It’s certainly the best handbook I’ve come across! Though reading Excession makes you realize how much we lack the ability to understand what AI will become (e.g., seems obvious that AI’s will not communicate in anything remotely resembling human language)
1