Measures the average level of uncertainty, surprise, or randomness associated with a random variable’s possible outcomes.
Quantifies the expected amount of information needed to represent or transmit an event, typically measured in bits.
High entropy indicates high uncertainty or unpredictability. Low entropy means the data is predictable or has low randomness.