- When: Monday/Wednesdays 3:30pm - 4:50pm
- Where: GHC 4401
| Date | Plan | Lecturer | Note | |
|---|---|---|---|---|
| 01/13 Mon |
Week 1: Why ML Systems?
[ slides ] |
Chen | ||
| 01/15 Wed |
Week 1: Introduction to deep learning and programming abstraction
[ slides ] |
Chen | ||
| 01/20 Mon |
Week 2: MLK Jr Day. No Class.
[ slides ] |
|||
| 01/22 Wed |
Week 2: Introduction to Machine Learning Systems
[ slides ] |
Chen | ||
| 01/27 Mon |
Week 3: Automatic Differentiation
[ slides ] |
Chen |
Lab 1 Release |
|
| 01/29 Wed |
Week 3: Hardware Acceleration
[ slides ] |
Chen | ||
| 02/03 Mon |
Week 4: GPU Architecture and CUDA Programming (1)
[ slides ] |
Chen | ||
| 02/05 Wed |
Week 4: GPU Architecture and CUDA Programming (2)
[ slides ] |
Chen | ||
| 02/10 Mon |
Week 5: ML Compilation (1)
[ slides ] |
Chen |
Lab 1 Due |
|
| 02/12 Wed |
Week 5: ML Compilation (2)
[ slides ] |
Chen |
Lab 2 Release |
|
| 02/17 Mon |
Week 6: Graph-level Optimization
[ slides ] |
Chen | ||
| 02/19 Wed |
Week 6: ML Parallelization (data parallelism and zero redundancy)
[ slides ] |
Chen | ||
| 02/24 Mon |
Week 7: ML Parallelization (model and pipeline parallelism)
[ slides ] |
Chen | ||
| 02/26 Wed |
Week 7: Memory Optimization
[ slides ] |
Chen |
Lab 2 Due |
|
| 03/03 Mon |
Week 8: Spring Break. No Class.
[ slides ] |
|||
| 03/05 Wed |
Week 8: Spring Break. No Class.
[ slides ] |
|||
| 03/10 Mon |
Week 9: LLMs: Introduction to Transformers + Attention
[ slides ] |
Chen |
Lab 3 Release |
|
| 03/12 Wed |
Week 9: LLMs: Attention Optimizations
[ slides ] |
Chen | ||
| 03/17 Mon |
Week 10: LLMs Serving Techniques
[ slides ] |
Chen | ||
| 03/19 Wed |
Week 10: LLMs Finetuning Techniques
[ slides ] |
Chen | ||
| 03/24 Mon |
Week 11: Guest Lecture
[ slides ] |
Lab 3 Due |
||
| 03/26 Wed |
Week 11: Meetings to discuss project ideas
[ slides ] |
Chen | ||
| 03/31 Mon |
Week 12: LLMs: Mixture of Experts
[ slides ] |
Chen |
Project Proposal Due (Tentative) |
|
| 04/02 Wed |
Week 12: Advanced topics: Lessons Learned from MLSys Research
[ slides ] |
Chen | ||
| 04/07 Mon |
Week 13: Advanced topics: Universal LLM Deployment with ML Compilation
[ slides ] |
Chen | ||
| 04/09 Wed |
Week 13: Guest Lecture
[ slides ] |
|||
| 04/14 Mon |
Week 14: Guest Lecture
[ slides ] |
|||
| 04/16 Wed |
Week 14:
[ slides ] |
|||
| 04/21 Mon |
Week 15:
[ slides ] |
|||
| 05/02 Fri |
Week 16: Final Poster Presentations
[ slides ] |
|||
| 05/04 Sun | Week 17: Final Report Due | |||
