I disagree strongly with many individual points here but am swayed by the primary one: it isn’t that GPT-2 is smart, it’s that human intelligence is perhaps less intelligent, less special, and less complicated than we expect it to be. slatestarcodex.com/2019/02/19/gpt