AI won't automatically do anything. Reason on its own cannot create motives for action. In humans, the motive for action comes from instinct. Reason doesn't create desire; it creates strategies for desire's fulfilment. AI will need something besides intelligence to have motives.
-
-
-
Humans have instincts & desires because evolution weeds out things that don't tend to reproduce -- which includes things that don't have survival instincts, sexual instincts, social instincts, &c. Instincts are specialized modules, tuned to particular environments.
-
Unlike evolution in a natural environment, there's nothing intrinsic to AI that would cause it to have a survival instinct, or instinct-like drives for any action at all. Such stuff would need to be either designed in, added extraneously, or evolved in an appropriate environment.
-
There's some fairly good arguments that a smart AI would probably reason itself to self-preservation. Even if your own goal in life is to manufacture paperclips it's possible to reason that ceasing to exist might fail to achieve that goal.
-
"Even if your own goal in life is to manufacture paperclips " Somebody would need to have programmed in the goal of manufacturing unlimited paperclips. Otherwise, no, there'd be no *reason* for the AI to try to extend its own lifespan.
-
Yes? my point was that any goal at all leads to a subset of instrumental goals like self-preservation. Even if the only goal you program in is something oddball there's a set of instrumental goals that fall out in most cases. One (any) motive leads to many instrumental motives.
-
"my point was that any goal at all leads to a subset of instrumental goals like self-preservation." Well, it doesn't. It makes no sense, from an engineering POV, to lumber an AI that's designed for a narrowly specific purpose with complex extra tasks such as self-preservation.
- 6 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.