Any specific reason we can't learn these insights? Like if we were somehow able to simulate "billions of lifetimes of experience"? I guess simulating this would already require some insights into the human niche.
AGI is the persistence of a technoscientific myth of contact with the superhuman at the heart of a secular enterprise; an allegory of faith in a disenchanted universe.
I see it more reverse engineering the final product and the understanding of how it changes. There might have been a billion changes to get there but I think it's doable.
It seems more like the mind starts at as a state from childhood then learns from the surroundings. People might start out from different states but doesn't seem that unique. I believe there is a limited amount of states.
Perhaps one most impressive features of humanity though is extent we have extended our niche to more general environments. I think a lot of that is a feature of our culture though more than just our intelligence.
Intelligent machines may adapt to a very different niche someday, e.g. autonomously maintained robotic factories on Mars. However, I suspect the mostly likely way for that to develop is in intelligent machines adapted to a niche that heavily overlaps with ours.
Ah ok got it. I think I interpret the term differently. The “general” to me doesn’t mean human-type necessarily. I really debate how much we should / should not anthropomorphize intelligence on a non-biological substrate. Thanks for taking the time to reply!
We already anthropomorphize as a given, the question will never be how much we want to do it, but how much we are able to. And we should strive to maximize it.
On Truth and Lies in a Nonmoral sense gets at the heart of this reality. It is the fork which generated modernity.