Conversation

What if it winds up as advanced compared to us as we are compared to ants? Or even compared to dogs or cats?

Quote Tweet

Mar 5, 2017

Most AI apocalypse scenarios seem predicated on the idea that the AI will be murderously insane. But what if it's just better than you?

Replying to

Imagine a frenetic, desperate scientist entering inputs to a text console. "Please let us live!"

Replying to

"Start a God's War, and humans are the ants. With zero malice, you will die in droves."

Cinder

@Triquetrea

Replying to

@iwelsh

It could just as easily turn out that an AI is perfectly content to build its own VR universe, leaving us to do our thing.

1:51 PM · Mar 5, 2017Twitter Web Client

Replying to

oh yes, we just don't 'know'. We also don't know how consciousness works.

Replying to

we could get AI that is not conscious but still hellishly effective and intelligent.

Replying to

Exactly my point. I think much of the AI philosophizing is predicated on getting the AI we hope to design.

Replying to

I mean we've already got AI self-optimizing itself and writing its own code. If you know algos work, you know that can go weird.

Replying to

Yeah that's ~ what I'm thinking. "We are creating an intelligence far more sophisticated than us, so it will work like this." Uh, no

Show replies