Skip to content

lilei199908/MIT-6.5940

Repository files navigation

MIT-6.5940

Lecture 1: Introduction

  • Video

Lecture 2: Basics of Deep Learning

  • Video
  • Lab 0 out

Chapter I: Efficient Inference

Lecture 3: Pruning and Sparsity (Part I)

  • Video

Lecture 4: Pruning and Sparsity (Part II)

  • Video
  • Lab 1 out

Lecture 5: Quantization (Part I)

  • Video
  • Lab 0 due

Lecture 6: Quantization (Part II)

  • Video

Lecture 7: Neural Architecture Search (Part I)

  • Video
  • Lab 1 due, Lab 2 out

Lecture 8: Neural Architecture Search (Part II)

  • Video

Lecture 9: Knowledge Distillation

  • Video

Lecture 10: MCUNet: TinyML on Microcontrollers

  • Video
  • Lab 2 due, Lab 3 out

Lecture 11: TinyEngine and Parallel Processing

  • Video

Student Holiday — No Class

Chapter II: Domain-Specific Optimization

Lecture 12: Transformer and LLM

  • Video

Lecture 13: Efficient LLM Deployment

  • Video (need learn more times)
  • Lab 3 due, Lab 4 out(copy one line, watch clamp to no zero)

Lecture 14: LLM Post Training

  • Video
  • Project ideas out

Lecture 15: Long Context LLM

  • Video

Lecture 16: Vision Transformer

  • Video
  • Lab 4 due, Lab 5 out

-------- Sanity check of reference implementation: Passed! -------- Section, Total time(ms), Average time(ms), Count, GOPs reference, 1737.512939, 173.751007, 10, 1.508731

-------- Sanity check of loop_unrolling implementation: Passed! -------- Section, Total time(ms), Average time(ms), Count, GOPs loop_unrolling, 1866.032959, 186.602997, 10, 1.404820

-------- Sanity check of multithreading implementation: Passed! -------- Section, Total time(ms), Average time(ms), Count, GOPs multithreading, 515.291992, 51.528999, 10, 5.087291

-------- Sanity check of simd_programming implementation: Passed! -------- Section, Total time(ms), Average time(ms), Count, GOPs simd_programming, 699.747009, 69.973999, 10, 3.746268

-------- Sanity check of multithreading_loop_unrolling implementation: Passed! -------- Section, Total time(ms), Average time(ms), Count, GOPs multithreading_loop_unrolling, 516.218018, 51.620998, 10, 5.078165

-------- Sanity check of all_techniques implementation: Passed! -------- Section, Total time(ms), Average time(ms), Count, GOPs all_techniques, 134.244003, 13.424000, 10, 19.527428

All tests completed!

Lecture 17: GAN, Video, and Point Cloud

  • Video

Lecture 18: Diffusion Model

  • Video

Chapter III: Efficient Training

Lecture 19: Distributed Training (Part I)

  • Video
  • Lab 5 due

Lecture 20: Distributed Training (Part II)

  • Video
  • Project proposal due

Lecture 21: On-Device Training and Transfer Learning

  • Video

Chapter IV: Advanced Topics

Lecture 22: Course Summary + Quantum Machine Learning I

  • Video

Lecture 23: Quantum Machine Learning II

  • Video

Thanksgiving — No Class

Lecture 24: Final Project Presentation

  • Video

Lecture 25: Final Project Presentation

  • Video

Lecture 26: Final Project Presentation

  • Video
  • Project report and course evaluation due

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors