"It appears that consciousness is a very rare & precious thing & we should take whatever steps we can to preserve the light of consciousness. Only now, after 4.5 billion years has that window been open. That’s a long time to wait and it might not stay open for long.” -
Conversation
The loss of civilization can be an unbounded cost. The low probability of something bad happening is, in and of itself, irrelevant. The relevant thing is the probability of the event weighted by its cost.