been thinking about math again and here's a math hot take for you: the principle of maximum entropy is false
-
hot takes are supposed to be punchy and overstated
i can clarify in a much more sober blog post, need to get my thoughts a little more in order first
the v. short version is that the fundamental feature of entropy is that it ~ the log of the multinomial distribution
you can see an early version of my current take in this blog post but i didn’t really understand the significance of it at the time:https://qchu.wordpress.com/2016/03/06/maximum-entropy-from-bayes-theorem/ …
