François CholletVerified account

A major missing piece for AGI, is humans' ability to set their own goals and reward functions. E.g. feeling rewarded for winning a "game"https://twitter.com/fchollet/status/876227262437179392 …

It's quite interesting that we can unilaterally decide to pursue certain artificial goals, and feel physically gratified when we reach them

In effect, we have the power to completely hack our own reward system, down to the ability to override e.g. pain avoidance

In that sense, "general intelligence" is not just the ability to find optimal solutions to externally-provided problems (making paperclips)

It is also the ability to figure out what goals you should pursue. Which in turn guides the development of your own intelligence

agree for cases where it can increase intelligence/achievement, but more broadly, goal creation as intelligence seems problematic-

seems like more of a wisdom thing in the general case, bordering on ethics in some cases, than intelligence per se, no?

certainly a big part of being human, whether or not it fits under intelligence banner