Lectures
You can find the relevant lecture links here. A tentative lecture plan is detailed below. We will add more details as the course progresses. In particular, recorded lecture videos will be available through Panopto Course Videos tool in Canvas.
Working draft of the lecture notes are available here. We have also released a tutorial on how to use the Stanford Compression Library.
You can also find last offering’s recorded video lectures at this YouTube Playlist.
-
Lecture 1 [2023-09-27]
Course Introduction, Lossless Data Compression Basics
[notes] [slides-part-1 (pdf)] [slides-part-1 (keynote)] [slides-part-2] [slides-part-2 (annotated)] [YouTube]
-
Lecture 2 [2023-10-02]
Prefix Free Codes
[Prefix Free Codes notes] [slides] [YouTube] [Prefix-free Compressor code]
-
Lecture 3 [2023-10-04]
Kraft Inequality, Entropy, Introduction to SCL
[Kraft Inequality notes] [Entropy notes] [slides] [YouTube]
-
-
Lecture 5 [2023-10-11]
Asymptotic Equipartition Property
[AEP notes] [YouTube] [Typical Set coder] [Block Coding colab] [slides (Huffman extended)]
-
-
Lecture 8 [2023-10-23]
Beyond IID distributions: Conditional entropy
[slides] [Non-IID Sources Notes] [YouTube]
-
Lecture 9 [2023-10-25]
Context-based AC & LLM Compression
[slides] [YouTube] [Context-based coding notes] [probability models code] [arithmetic coding code]
-
Lecture 10 [2023-10-30]
LZ and Universal Compression
[slides] [slides annotated] [YouTube] [LZ77 Compressor] [LZ77 Sliding Window]
-
Lecture 11 [2023-11-01]
Lossy Compression Basics; Quantization
[slides] [slides (annotated)] [quantization notes] [YouTube] [quantization colab notebook]
-
Lecture 13 [2023-11-08]
Gaussian RD, Water-Filling Intuition; Transform Coding
[notes] [slides] [slides (annotated)] [YouTube]
-
Lecture 14 [2023-11-13]
Transform Coding in real-life: image, audio, etc.
[Slides] [Slides (annotated)] [YouTube] [Transform Coding Notebook] [Audio Compression Notebook]
-
-
-
-
Lecture 19 [2023-12-06]
Student Presentations