There may be a limit to the individual intelligence of an organism: once a mind figures out how it works, it is going to opt out of serving its evolutionary reward functions. Intelligence may be capped a hair above understanding AI. #LebowskiTheorem
-
-
Replying to @Plinz
What happens when an agent opts out of its reward function? What does it do then, if it’s able to control its motives / capacity to reason?
1 reply 0 retweets 0 likes -
Replying to @krishkhubchand
If you fully opt out, you either cede control to another self running on the same brain, or your organism dies (while you don't care).
2 replies 0 retweets 1 like -
Replying to @Plinz
That seems kind of... underwhelming. It’s like a nihilistic self destruct. Do you think that opting out of the reward-function is a logical outcome of reaching a certain level of intelligence tho?
1 reply 0 retweets 0 likes -
Replying to @krishkhubchand
No, intelligence is just the ability to make models, and in practice a prosthesis that people use to compensate for lack of wisdom and healthy instincts.
1 reply 1 retweet 0 likes -
Replying to @Plinz
How would you define healthy instincts & wisdom then? The ability to take advantage of accurate models, or not being reliant on a positive model and being able to act positively anyways via heuristics?
1 reply 0 retweets 0 likes -
Replying to @krishkhubchand
Wisdom can be understood as the ability to understand what your needs are, to make good models of you can satisfy them, and to act on them.
1 reply 0 retweets 0 likes -
Replying to @Plinz
What role do values play in wisdom? Values can often conflict w needs, what route does a wise person/agent follow?
1 reply 0 retweets 0 likes
It is not hard to figure out that values are not objectively real, but a cultural programming. If you values are not sustainable, you can change them into something that is.
-
-
Replying to @Plinz
What about needs? Religious martyrs or political prisoners who die from not eating — those are examples of people putting their values (derived from culture + internal map of meaning/narrative/identity of self) ahead of needs.
0 replies 0 retweets 0 likesThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.