This is a list of information theory topics.
- A Mathematical Theory of Communication
- algorithmic information theory
- arithmetic coding
- channel capacity
- Communication Theory of Secrecy Systems
- conditional entropy
- conditional quantum entropy
- confusion and diffusion
- cross-entropy
- data compression
- entropic uncertainty (Hirchman uncertainty)
- entropy encoding
- entropy (information theory)
- Fisher information
- Hick's law
- Huffman coding
- information bottleneck method
- information theoretic security
- information theory
- joint entropy
- Kullback–Leibler divergence
- lossless compression
- negentropy
- noisy-channel coding theorem (Shannon's theorem)
- principle of maximum entropy
- quantum information science
- range encoding
- redundancy (information theory)
- Rényi entropy
- self-information
- Shannon–Hartley theorem
Wikiwand in your browser!
Seamless Wikipedia browsing. On steroids.
Every time you click a link to Wikipedia, Wiktionary or Wikiquote in your browser's search results, it will show the modern Wikiwand interface.
Wikiwand extension is a five stars, simple, with minimum permission required to keep your browsing private, safe and transparent.
