Eliezer and Bostrom are well aware of No Free Lunch. They argue that Orthogonality holds in practice in AGI, which may be incorrect, but that seems to be the meat of the argument, and probably depends mostly on what we mean by 'in practice'.https://twitter.com/s_r_constantin/status/1164307173075120129 …
I know Eliezer knows this. He might not have been aware that when humanities people say things are not value-free, to the extent they’re correct, they’re talking about this.