Information theory MOC

Shannon entropy

The Shannon entropy or information-theoretic entropy of a discrete random variable is the Expectation of its Shannon information , #m/def/info

where corresponds to the unit , corresponds to the unit , and corresponds to the unit . Shannon entropy is closely related to thermodynamic entropy.

#state/develop | #lang/en | #SemBr