Conversation

Well, it’s simply too abstract/immaterial for my tastes. AI will be used whenever it can be done to make/save money, in whatever capacity it does so. Doesn’t really matter what we think is best or safest or whatever. Just AI realpolitik.
2
2
I think the will of humanity is a concrete, measurable signal that can be used for alignment. And aligning AI impact with that = AI that maximizes humanity's agency. I agree tho that profit maximization is the force that will dominate. So we need to create the right market… Show more
4
3
If you write out a sufficiently concrete proposal for exactly how to input 'will of humanity' numbers in a reward function for a superintelligent reinforcement learner, I can try to explain to you how that'd still kill everyone, even assuming away all inner misalignment issues.
5
16
will of humanity: don’t kill or harm people; don’t take actions that would cause humans to be harmed or killed. always leave humans in any loop that might culminate in fatal harm to humans
8
6
Asimov explicitly stipulates that the Three Laws are not a technical description of the robots' programming, but an easy to understand *summary* of the outcome of a technical mechanism with lots of mathematical details under the hood that look lots of person-hours to develop.
1
But fair point that I am implicitly treating Gary as a naΓ―f who has not heard of Asimov when that makes no sense and I should be treating him as someone who knows enough to understand that he's responding to Eliezer with a nonsequitur. Sorry!
1