- When: Monday/Wednesdays 3:30pm - 4:50pm
- Where: GHC 4401
| Date | Plan | Lecturer | Note | |
|---|---|---|---|---|
| 01/12 Mon |
Week 1: Why ML Systems?
[ slides ] |
Tianqi Chen | ||
| 01/14 Wed |
Week 1: Introduction to Machine Learning Systems
[ slides ] |
Tianqi Chen | ||
| 01/19 Mon |
Week 2: MLK Jr Day. No Class.
[ slides ] |
|||
| 01/21 Wed |
Week 2: Intro to deep learning and programming abstraction
[ slides ] |
Tianqi Chen | ||
| 01/26 Mon |
Week 3: Automatic Differentiation
[ slides ] |
Tianqi Chen |
Lab 1 Release |
|
| 01/28 Wed |
Week 3: Optimizing Linear Algbera
[ slides ] |
Tianqi Chen | ||
| 02/02 Mon |
Week 4: GPU Architecture and CUDA Programming (1)
[ slides ] |
Zhihao Jia | ||
| 02/04 Wed |
Week 4: GPU Architecture and CUDA Programming (2)
[ slides ] |
Zhihao Jia | ||
| 02/09 Mon |
Week 5: Case study: Transformer, Attention, Optimizations
[ slides ] |
Zhihao Jia | ||
| 02/11 Wed |
Week 5: ML Parallelization (data parallelism and zero redundancy)
[ slides ] |
Zhihao Jia |
Lab 1 Due |
|
| 02/16 Mon |
Week 6: ML Parallelization (model and pipeline parallelism)
[ slides ] |
Zhihao Jia |
Lab 2 Release |
|
| 02/18 Wed |
Week 6: ML Compiler (1)
[ slides ] |
Tianqi Chen | ||
| 02/23 Mon |
Week 7: ML Compiler (2) - autotuning
[ slides ] |
Tianqi Chen | ||
| 02/25 Wed |
Week 7: Memory Optimizations: Tensor Rematerialization and Offload
[ slides ] |
Tianqi Chen | ||
| 03/02 Mon |
Week 8: Spring Break. No Class.
[ slides ] |
|||
| 03/04 Wed |
Week 8: Spring Break. No Class.
[ slides ] |
|||
| 03/09 Mon |
Week 9: LLMs: Serving (speculative decoding, continuous batching)
[ slides ] |
Zhihao Jia |
Lab 3 Release; Lab 2 Due |
|
| 03/11 Wed |
Week 9: Meetings to discuss project ideas with mentors
[ slides ] |
|||
| 03/16 Mon |
Week 10: LLMs: Training (PEFT)
[ slides ] |
Zhihao Jia | ||
| 03/18 Wed |
Week 10: LLMs: Mixture of Experts
[ slides ] |
Tianqi Chen | ||
| 03/23 Mon |
Week 11: Advanced topics: Kernel DSLs and Warp Specialization
[ slides ] |
Tianqi Chen | ||
| 03/25 Wed |
Week 11: Advanced topics: Graph-level Optimization
[ slides ] |
Zhihao Jia |
Project Proposal Due (Tentative) |
|
| 03/30 Mon |
Week 12: Advanced topics: MegaKernels
[ slides ] |
Zhihao Jia |
Lab 3 Due |
|
| 04/01 Wed |
Week 12: Advanced topics: ML super optimization
[ slides ] |
Zhihao Jia | ||
| 04/06 Mon |
Week 13: Advanced topics: Automated ML Parallelization
[ slides ] |
Zhihao Jia | ||
| 04/08 Wed |
Week 13: Advanced topics: TBD
[ slides ] |
|||
| 04/13 Mon |
Week 14: Guest Lecture: TBD
[ slides ] |
|||
| 04/15 Wed |
Week 14: Guest Lecture: TBD
[ slides ] |
|||
| 04/20 Mon |
Week 15:
[ slides ] |
|||
| 04/22 Thu | Week 16: Final Poster Presentations | |||
