- When: Monday/Wednesdays 3:30pm - 4:50pm
- Where: Posner Hall 151
Date | Plan | Lecturer | Note | |
---|---|---|---|---|
01/17 Wed |
Week 1: Why ML Systems?
[ slides ] |
Both | ||
01/22 Mon |
Week 2: Introduction to deep learning and programming abstraction
[ slides ] |
Chen | ||
01/24 Wed |
Week 2: Introduction to Machine Learning Systems
[ slides ] |
Chen | ||
01/29 Mon |
Week 3: Automatic Differentiation
[ slides ] |
Chen | ||
01/31 Wed |
Week 3: Hardware Acceleration
[ slides ] |
Chen | ||
02/05 Mon |
Week 4: GPU Architecture and CUDA Programming (1)
[ slides ] |
Jia | ||
02/07 Wed |
Week 4: GPU Architecture and CUDA Programming (2)
[ slides ] |
Jia | ||
02/12 Mon |
Week 5: ML Compilation (1)
[ slides ] |
Chen |
Lab 1 Due |
|
02/14 Wed |
Week 5: ML Compilation (2)
[ slides ] |
Chen | ||
02/19 Mon |
Week 6: Graph-level Optimization
[ slides ] |
Jia | ||
02/21 Wed |
Week 6: ML Parallelization (data parallelism and zero redundancy)
[ slides ] |
Jia | ||
02/26 Mon |
Week 7: ML Parallelization (model and pipeline parallelism)
[ slides ] |
Jia | ||
02/28 Wed |
Week 7: Memory Optimization
[ slides ] |
Chen |
Lab 2 Due |
|
03/04 Mon |
Week 8: Spring Break. No Class.
[ slides ] |
|||
03/06 Wed |
Week 8: Spring Break. No Class.
[ slides ] |
|||
03/11 Mon |
Week 9: LLMs: Introduction to Transformers + Attention
[ slides ] |
Chen |
Lab 3 Release |
|
03/13 Wed |
Week 9: LLMs: Attention Optimizations
[ slides ] |
Jia | ||
03/18 Mon |
Week 10: LLMs Serving Techniques
[ slides ] |
Jia | ||
03/20 Wed |
Week 10: LLMs Finetuning Techniques
[ slides ] |
Jia | ||
03/25 Mon |
Week 11: LLMs: Long-Context Generation
[ slides ] |
Tianyu Gao (Princeton) |
Lab 3 Due |
|
03/27 Wed |
Week 11: Meetings to discuss project ideas
[ slides ] |
Both | ||
04/01 Mon |
Week 12: LLMs: Mixture of Experts
[ slides ] |
Chen |
Project Proposal Due (Tentative) |
|
04/03 Wed |
Week 12: Advanced topics: Lessons Learned from MLSys Research
[ slides ] |
Jia | ||
04/08 Mon |
Week 13: Advanced topics: Universal LLM Deployment with ML Compilation
[ slides ] |
Chen | ||
04/10 Wed |
Week 13: Guest Lecture: Assessing and Improving Large Language Models
[ slides ] |
Lei Li | ||
04/15 Mon |
Week 14: Guest Lecture
[ slides ] |
Beidi Chen | ||
04/17 Wed |
Week 14:
[ slides ] |
|||
04/22 Mon |
Week 15:
[ slides ] |
|||
05/02 Thu |
Week 17:
[ slides ] |
Project Presentation Video Recording Due |
||
05/03 Fri |
Week 17: Final Poster Presentations
[ slides ] |
|||
05/05 Sun | Week 17: |