8 questions · 3 sources · 0 syntheses
Information Theory
The mathematical study of information, entropy, and communication.
Source-derived questions
Questions extracted from the papers in this topic, excluding the curated questions above.
- How did Shannon define entropy as a measure of information?
- How did Shannon prove that a noisy communication channel has a maximum reliable transmission rate?
- What core ideas did Claude Shannon establish in his 1948 paper 'A Mathematical Theory of Communication'?
- What is the Shannon limit, and why can it be approached but never exceeded?
- What is the mathematical definition of information as entropy that Shannon introduced?
- What modern technologies trace their engineering foundations back to Shannon's 1948 paper?
- What point was Hamming making in his 1986 lecture 'You and Your Research' about why some scientists do important work?
- Why was defining the bit as a unit of uncertainty such a significant conceptual step?