- When: Monday/Wednesdays 3:30pm - 4:50pm
- Where: Posner Hall 151
| Date | Plan | Lecturer | Note | |
|---|---|---|---|---|
| 01/17 Wed |
Week 1: Why ML Systems?
[ slides ] |
Both | ||
| 01/22 Mon |
Week 2: Introduction to deep learning and programming abstraction
[ slides ] |
Chen | ||
| 01/24 Wed |
Week 2: Introduction to Machine Learning Systems
[ slides ] |
Chen | ||
| 01/29 Mon |
Week 3: Automatic Differentiation
[ slides ] |
Chen | ||
| 01/31 Wed |
Week 3: Hardware Acceleration
[ slides ] |
Chen | ||
| 02/05 Mon |
Week 4: GPU Architecture and CUDA Programming (1)
[ slides ] |
Jia | ||
| 02/07 Wed |
Week 4: GPU Architecture and CUDA Programming (2)
[ slides ] |
Jia | ||
| 02/12 Mon |
Week 5: ML Compilation (1)
[ slides ] |
Chen |
Lab 1 Due |
|
| 02/14 Wed |
Week 5: ML Compilation (2)
[ slides ] |
Chen | ||
| 02/19 Mon |
Week 6: Graph-level Optimization
[ slides ] |
Jia | ||
| 02/21 Wed |
Week 6: ML Parallelization (data parallelism and zero redundancy)
[ slides ] |
Jia | ||
| 02/26 Mon |
Week 7: ML Parallelization (model and pipeline parallelism)
[ slides ] |
Jia | ||
| 02/28 Wed |
Week 7: Memory Optimization
[ slides ] |
Chen |
Lab 2 Due |
|
| 03/04 Mon |
Week 8: Spring Break. No Class.
[ slides ] |
|||
| 03/06 Wed |
Week 8: Spring Break. No Class.
[ slides ] |
|||
| 03/11 Mon |
Week 9: LLMs: Introduction to Transformers + Attention
[ slides ] |
Chen |
Lab 3 Release |
|
| 03/13 Wed |
Week 9: LLMs: Attention Optimizations
[ slides ] |
Jia | ||
| 03/18 Mon |
Week 10: LLMs Serving Techniques
[ slides ] |
Jia | ||
| 03/20 Wed |
Week 10: LLMs Finetuning Techniques
[ slides ] |
Jia | ||
| 03/25 Mon |
Week 11: LLMs: Long-Context Generation
[ slides ] |
Tianyu Gao (Princeton) |
Lab 3 Due |
|
| 03/27 Wed |
Week 11: Meetings to discuss project ideas
[ slides ] |
Both | ||
| 04/01 Mon |
Week 12: LLMs: Mixture of Experts
[ slides ] |
Chen |
Project Proposal Due (Tentative) |
|
| 04/03 Wed |
Week 12: Advanced topics: Lessons Learned from MLSys Research
[ slides ] |
Jia | ||
| 04/08 Mon |
Week 13: Advanced topics: Universal LLM Deployment with ML Compilation
[ slides ] |
Chen | ||
| 04/10 Wed |
Week 13: Guest Lecture: Assessing and Improving Large Language Models
[ slides ] |
Lei Li | ||
| 04/15 Mon |
Week 14: Guest Lecture
[ slides ] |
Beidi Chen | ||
| 04/17 Wed |
Week 14:
[ slides ] |
|||
| 04/22 Mon |
Week 15:
[ slides ] |
|||
| 05/02 Thu |
Week 17:
[ slides ] |
Project Presentation Video Recording Due |
||
| 05/03 Fri |
Week 17: Final Poster Presentations
[ slides ] |
|||
| 05/05 Sun | Week 17: | |||
