Repository Index

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

• deep-learning
• pytorch
• gpu
• machine-learning

Machine Learning Engineering Open Book

• pytorch
• slurm
• large-language-models
• llm

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

• inference
• gpu
• machine-learning
• deep-learning

🧱 Experimental library for building inference engines

• inference
• llm
• cuda
• gpt-oss