Courses

CS25: Transformers United V2

https://web.stanford.edu/class/cs25/index.html#course video https://www.youtube.com/watch?v=XfpMkf4rD6E&list=PLVVTN-yNn8rvEwlY8ClxDUWeVPVfdifYj

Learning-Based Image Synthesis

https://learning-image-synthesis.github.io/sp23/

LLM in Practice

Recent Advances

Advances in Foundation Models Winter 2023

https://stanford-cs324.github.io/winter2023/

LLM Bootcamp 2023

https://fullstackdeeplearning.com/llm-bootcamp/spring-2023/

Towards AGI: Scaling, Alignment & Emergent Behaviors in Neural Nets

https://sites.google.com/view/towards-agi-course/course-description

Survey

  1. Efficient Transformer: A Survey
  2. Full Stack Optimization of Transformer Inference: a Survey
  3. A Survey of Techniques for Optimizing Transformer Inference

Tutorials, Paper, Blogs

  1. Transformers
    1. [NeurIPS’17] Attention is All You Need | Google Brain, Google Research