6 years, 1 month ago

Laying Foundation for Digital Age: Claude Shannon, 1948

“The informational value of a message, whether it’s spoken, written, or encoded in silicon, is a function of how much the recipient already knows. If an outcome is highly unpredictable, a message communicating the outcome carries more information (and requires more bits) than if the outcome is more predictable (e.g., learning that a two-headed coin […]