Does the argument from instrumental convergence really not even warrant a passing mention in an article like this?
-
-
-
The arguments for AI risk 1) have been laid out very clearly for years by people like Nick Bostrom and 2) bear no resemblance to the argument that this article criticises
Kraj razgovora
Novi razgovor -
-
-
General rule: the more powerful the technology, the more dangerous the unintended consequences. Also, being "taken care of" is the same as being dominated from the viewpoint of inferior intelligence, like we "take care of" other animal species..
- Još 1 odgovor
Novi razgovor -
-
-
I'm not worried about a Terminator scenario. I'm worried about an AI in charge of a critical system failing spectacularly when it encounters a situation that doesn't fit its training data.
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
-
-
We probably need a new term like AC for Artificial Consciousness to represent an AI/AGI/ASI that is self-aware/conscious (which I think is what a lot of people expect and maybe want) vs vertical intelligences that I think are much less threatening (unless misused by humans.)
-
To me the difference is that an AC can set its own goals. Vertical intelligences are goal seeking, but the goal is set by humans, which could lead to the paperclip apocalypse which seems unlikely.
Kraj razgovora
Novi razgovor -
-
-
I think this ispremature. Existing RL agents can't do look-ahead planning outside of narrow regimes, or situations that came up frequently in training. Agents with broad planning abilities will have *fundamentally* different properties. https://en.wikipedia.org/wiki/Instrumental_convergence …
-
Traditional RL distills what it's seen before and through brute repetition fins general patterns. But it doesn't foresee specific negative outcomes that it's never encountered before and plan to avoid them. If it did, it would be considerably more dangerous.
Kraj razgovora
Novi razgovor -
-
-
Tweet je nedostupan.
-
Exactly, "it didn’t develop the survival instinct" but the dudes running it did.
Kraj razgovora
-
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.