François CholletVerified account

In effect, we have the power to completely hack our own reward system, down to the ability to override e.g. pain avoidance

In that sense, "general intelligence" is not just the ability to find optimal solutions to externally-provided problems (making paperclips)

It is also the ability to figure out what goals you should pursue. Which in turn guides the development of your own intelligence

agree for cases where it can increase intelligence/achievement, but more broadly, goal creation as intelligence seems problematic-

seems like more of a wisdom thing in the general case, bordering on ethics in some cases, than intelligence per se, no?

certainly a big part of being human, whether or not it fits under intelligence banner

It does, much like, say, intrinsic motivation for reinforcement learning, or hierarchical sub-goal generation for curriculum learning

what's your definition of intelligence?