Lectures
You can find the relevant lecture material here. A tentative lecture plan is detailed below. We will add more details as the course progresses.
Working draft of the lecture notes are available here.
You can also find last offering’s recorded video lectures at this YouTube Playlist.
-
Week 1 [2025-09-23]
Course Introduction, Lossless Data Compression Basics
[slides (pdf)] [demo code]
-
Week 2 [2025-09-30]
Review + Introduction to Stanford compression library (SCL)
[Colab Notebook]
Pre-lecture material from Fall 2023 Website
- 2023 Lecture 1 part 2: Introduction to lossless compression
- 2023 Lecture 2: Prefix Free Codes
- 2023 Lecture 3: Kraft Inequality, Entropy, Introduction to SCL
-
Week 3 [2025-10-07]
Review + Canonical Prefix Huffman and Succinct Data Structures
Pre-lecture material from Fall 2023 Website
- 2023 Lecture 4: Huffman Codes
- 2023 Lecture 5: Asymptotic Equipartion Property
-
Week 4 [2025-10-14]
Review + extensions of ANS, including rANS and tANS
Pre-lecture material from Fall 2023 Website
- 2023 Lecture 6: Arithmetic Coding
- 2023 Lecture 7: ANS
-
Week 5 [2025-10-21]
Review + Extensions and Applications of Context-based Methods
Pre-lecture material from Fall 2023 Website
- 2023 Lecture 8: Beyond IID distributions: Conditional entropy
- 2023 Lecture 9: Context-based AC & LLM Compression
-
Week 6 [2025-10-28]
Guest Lecture on Zstandard
Pre-lecture material from Fall 2023 Website
- 2023 Lecture 10: LZ and Universal Compression
- 2023 Lecture 11: Lossy Compression Basics; Quantization
-
Week 7 [2025-11-04]
Election day, go vote! No Lecture.
Pre-lecture material from Fall 2023 Website
- 2023 Lecture 12: Mutual Information; Rate-Distortion Function
- 2023 Lecture 13: Gaussian RD, Water-Filling Intuition; Transform Coding
-
Week 8 [2025-11-11]
Lossy Compression Review + Side Information (e.g., Slepian-Wolf)
Pre-lecture material from Fall 2023 Website
- 2023 Lecture 14: Transform Coding in real-life: image, audio, etc.
- 2023 Lecture 15: Image Compression: JPEG, BPG
-
Week 9 [2025-11-18]
Guest lecture on learning-based compression
Pre-lecture material from Fall 2023 Website
- 2023 Lecture 16: Learnt Image Compression
- 2023 Lecture 17: Humans and Compression
-
Week 10 [2025-11-25]
Thanksgiving Break! No Lecture.
-
Week 11 [2025-12-02; 2025-12-04]
Guest Lecture on Video Compression; Student Project Presentations
Pre-lecture material from Fall 2023 Website
- 2023 Lecture 18: Video Compression