Entropy and Information Theory

1. Information Sources
Robert M. Gray

2. Pair Processes: Channels, Codes, and Couplings
Robert M. Gray

3. Entropy
Robert M. Gray

4. The Entropy Ergodic Theorem
Robert M. Gray

5. Distortion and Approximation
Robert M. Gray

6. Distortion and Entropy
Robert M. Gray

7. Relative Entropy
Robert M. Gray

8. Information Rates
Robert M. Gray

9. Distortion and Information
Robert M. Gray

10. Relative Entropy Rates
Robert M. Gray

11. Ergodic Theorems for Densities
Robert M. Gray

12. Source Coding Theorems
Robert M. Gray

13. Properties of Good Source Codes
Robert M. Gray

14. Coding for Noisy Channels
Robert M. Gray

Avainsanat: Engineering, Signal, Image and Speech Processing, Communications Engineering, Networks, Statistics for Engineering, Physics, Computer Science, Chemistry and Earth Sciences, Probability Theory and Stochastic Processes, Coding and Information Theory