The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Repository Index
47,133 repositories indexed
1–3 of 3 · Most stars
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
Network probing tool crafted for datacenters (but not only)
- datacenter
- network
- probing
- scapy