Gradient descent will take any shortcut available to map inputs to targets. Human perception works differently: it starts from a different input (embodied stream vs static images), it doesn't have a target for each input, and it isn't trained with SGD.https://www.quantamagazine.org/where-we-see-shapes-ai-sees-textures-20190701/ …
-
Indeed!! I later found out that he does not know the difference between 6 and 9. He learnt one of them and he stored it as you mentioned as symmetry-invariant and then when the other one came, he just considered it as the same as the first one.
It's really quite impressive -- for an adult it would take significant mental effort to draw the mirror version of a complex character, but children do it spontaneously & effortlessly after only looking at a few correctly-oriented examples. E.g. Japanese: https://matome.naver.jp/m/odai/2139156029049871901/2139156546952734803 …
