I've never been quite clear how straightforward the relationship is between thermodynamic entropy and info. theory entropy. Is it just that thermodynamic entropy is equal to info. theory entropy for a discrete uniform distribution over a number of outcomes equal to...
-
I should have thought before I typed, it looks like it is equal to that up to a scaling factor. What's k?
just a proportionality constant .. in natural units we take the boltzmann constant k=1
