1. EE274: Data Compression, course notes
  2. 1. Lossless data compression: basics
    1. 1.1. Introduction
    2. 1.2. Prefix Free Codes
    3. 1.3. Kraft Inequality
    4. 1.4. Entropy and Neg-log likelihood thumb rule
    5. 1.5. Huffman coding
    6. 1.6. Asymptotic Equipartition Property
    7. 1.7. Arithmetic coding
    8. 1.8. Asymmetric Numeral Systems
    9. 1.9. Non IID Sources and Entropy Rate
    10. 1.10. Context-based coding
    11. 1.11. Universal Compression with LZ77
    12. 1.12. Practical Tips on Lossless Compression
  3. 2. Lossy data Compression
    1. 2.1. Basics and Quantization
    2. 2.2. Rate-Distortion Theory
    3. 2.3. Transform Coding Theory
  4. 3. Resources
  5. 4. Homeworks
    1. 4.1. HW1
    2. 4.2. HW1 Solution
    3. 4.3. HW2
    4. 4.4. HW3
  6. 5. Project
  7. 6. SCL Tutorial
    1. 6.1. SCL Basics
    2. 6.2. SCL Exercise
  8. 7. Quiz Problems (2023)

Lossless data compression

The first part of the lecture notes pertain with lossless data compression

  1. Introduction
  2. Prefix Free Codes
  3. Kraft Inequality
  4. Entropy and Neg-log likelihood thumb rule
  5. Huffman coding
  6. Asymptotic Equipartition Property
  7. Arithmetic coding
  8. Asymmetric Numeral Systems