Conversation

What if it winds up as advanced compared to us as we are compared to ants? Or even compared to dogs or cats?

Quote Tweet

Mar 5, 2017

Most AI apocalypse scenarios seem predicated on the idea that the AI will be murderously insane. But what if it's just better than you?

Replying to

Imagine a frenetic, desperate scientist entering inputs to a text console. "Please let us live!"

Replying to

"Start a God's War, and humans are the ants. With zero malice, you will die in droves."

Replying to

It could just as easily turn out that an AI is perfectly content to build its own VR universe, leaving us to do our thing.

Replying to

I mean we've already got AI self-optimizing itself and writing its own code. If you know algos work, you know that can go weird.

Cinder

@Triquetrea

Replying to

@iwelsh

Yeah that's ~ what I'm thinking. "We are creating an intelligence far more sophisticated than us, so it will work like this." Uh, no

1:57 PM · Mar 5, 2017Twitter Web Client

Replying to

Well, we'll see. It isn't yet. Human brains/bodies are very complicated. And there may be other considerations.

Replying to

Wouldn't be surprised if we're even dumber than we think, but happen to compensate using quantum computing or actual psychic powers.

Show replies

Replying to

but yeah, we're playing golem-maker; juggling nitro, whatever metaphor/myth one wishes to use.

Replying to

Golem seems apt. Autonomous drones are modern-day golems. Even have similar operating models and limitations.

Show replies

Replying to

otoh, Banks style utopia is certainly possible. It's just not clear. Maybe we'll get lucky, get life extension, and see.