dictionary · English Wiktionary
information entropy
Pronunciation IH0 N F ER0 M EY1 SH AH0 N EH0 N T R AH0 P IY01 definition(s) across 1 part(s) of speech · fetched 2026-11-19
information entropy is an English headword with 1 Wiktionary sense (Noun).
Noun1 sense
A measure of the uncertainty associated with a random variable; a measure of the average information content one is missing when one does not know the value of the random variable (usually in units such as bits); the amount of information (measured in, say, bits) contained per average instance of a character in a stream of characters.