Is there a risk of nuclear war problem? Do you think there is something analogous with AI?
The people worried about AI alignment are worried about the concrete destruction of the things we value, in a similar way to 20th century physicists concerned with nuclear weapons
Yes. That's real. And you can zoom in on the specific threat of proliferation of fissile materials. You can literally measure and track lumps of matter... uranium etc. The part of AI fears that is real isn't original to "AI" and the part that is original to AI isn't real.
That would be surprising if true, for the same reason it would be surprising to me if biological weapons shared the same risk profile as nuclear weapons. There are big differences, like the potential for indefinite self replication. Or the legibility of the threat. Same with AI