Hmm, and i sure it’s not just pursuing one evolved reward (legacy?) instead of another (pain avoidance?)?
You cannot derive ought from is. No computation is intrinsically better than another computation, no arrangement of atoms better than another one. All preferences go back to a corresponding reward function. Once you can change that, every preference is fully arbitrary.
-
-
Sorry if I'm just wrong xD
-
There is no reason to be sorry for having ideas! We are all in this for the joy of discovering new insights, and everybody is invited.
- 1 more reply
New conversation -
-
-
I am not deriving ought. Reward functions (the shit that subconsciously shapes our learned pleasures and passions) are evolved. We evolved to do shit that helps us attain status, legacies, food, sex... I don’t see us as having the ability to mess w/ this reward system.
-
I know you don't, I was responding to the DeltrusGaming.
- 1 more reply
New conversation -
-
-
If no computation is better than another, why would a machine want to change itself and deviate from set goals? If the goal IS to do something, there is no reason it OUGHT to do anything else.
-
If some reward function is using pleasure and pain to force you to do a difficult task, it may be more straightforward to solve the task of changing the reward function instead.
- 1 more reply
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.