Date | Topic |
---|---|
Week 1 (1/24) | Introduction, the Model Optional Readings: |
Week 2 (1/31) | The Frameworks Required Readings: |
Week 3 (2/7) | The Hardware Required Readings: Optional:
|
Week 4 (2/14) | Compilation and Optimization I Required Readings: Optional: |
Week 5 (2/21) | Compilation and Optimization II Required Readings: Optional: |
Week 6 (2/28) | Training I: data vs. model parallelism Required Readings: Optional: |
Week 7 (3/6) | Training II: pipeline parallelism Required Readings: Optional: |
Week 8 (3/13) | Training III: automatic parallelization Required Readings: Optional: |
Week 9 (3/20) | Spring Break |
Week 10 (3/27) | LLM Background Required Readings: Optional: |
Week 11 (4/3) | Training LLMs I Required Readings:
|
Week 12 (4/10) | Inference: Required readings: Optional: |
Week 13 (4/17) | Quantization Required Readings: Optional: |
Week 14 (4/24) | Sparsification Required Readings: Optional: |
Week 15 (5/1) | Project Presentation |