Background

NVIDIA Deep Learning Performance Guide

https://docs.nvidia.com/deeplearning/performance/index.html#optimizing-performance

Full-Stack, GPU-based Acceleration of Deep Learning

NVIDIA CVPR’23 Tutorial https://nvlabs.github.io/EfficientDL/

Full-Stack Deep Learning

https://fullstackdeeplearning.com/course/2022/

• Lecture 1: Course Vision and When to Use ML https://fullstackdeeplearning.com/course/2022/lecture-1-course-vision-and-when-to-use-ml/
• Lecture 2: Development Infrastructure & Tooling https://fullstackdeeplearning.com/course/2022/lecture-2-development-infrastructure-and-tooling/
• Lecture 3: Troubleshooting & Testing https://fullstackdeeplearning.com/course/2022/lecture-3-troubleshooting-and-testing/
• Lecture 4: Data Management https://fullstackdeeplearning.com/course/2022/lecture-4-data-management/
• Lecture 5: Deployment https://fullstackdeeplearning.com/course/2022/lecture-5-deployment/
• Lecture 6: Continual Learning https://fullstackdeeplearning.com/course/2022/lecture-6-continual-learning/
• Lecture 7: Foundation Models https://fullstackdeeplearning.com/course/2022/lecture-7-foundation-models/
• Lecture 8: ML Teams and Project Management https://fullstackdeeplearning.com/course/2022/lecture-8-teams-and-pm/
• Lecture 9: Ethics https://fullstackdeeplearning.com/course/2022/lecture-9-ethics/
• Lab 04: Experiment Management https://colab.research.google.com/github/full-stack-deep-learning/fsdl-text-recognizer-2022-labs/blob/main/lab04/notebooks/lab04_experiments.ipynb

Efficient Deep Learning Systems

https://github.com/mryab/efficient-dl-systems