https://overcast.fm/+Ic2hwsH2U/1:10:49 … #AI
“You could build a mind that thought that 51 was a prime number but otherwise had no defect of its intelligence – if you knew what you were doing” —@ESYudkowsky
Is it possible build a mind able to learn but incapable of correcting this error? (Why?)
-
-
Replying to @reasonisfun @ESYudkowsky
It isn't possible. Because from '51 not prime' you could lead it into a contradiction, such as 1=0. Then it would display another defect e.g. denying that that was a contradiction.
4 replies 1 retweet 23 likes -
Most humans are such minds. Once they are sufficiently incentivized to believe in the divine revelation of 51 not being prime, they usually learn to compartmentalize that. Humans tend to have incredibly fragmented world models, at the cost of impairing independent inference.
3 replies 0 retweets 2 likes -
That's exactly not the startling claim I was making. Humans are generally nuts. I'm claiming that a perfected technology of mind could create a mind that was generally sane and specifically nuts.
3 replies 0 retweets 3 likes
Sorry, I did not read carefully enough. Eliezer, are you not that specifically perfected mind?
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.