TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
Heterogeneous GPU Sharing on Kubernetes
- vgpu
- gpu-virtualization
- device-plugin
- gpu-management
Jenkins X provides automated CI+CD for Kubernetes with Preview Environments on Pull Requests using Cloud Native pipelines from Tekton
Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)
Nydus - a reliable, high-performance on-demand load filesytem framework for container image and data distribution.
- container
- container-image
- accelerator
- snapshotter
Community-driven baseline to accelerate Intune adoption and learning.
Enterprise Kubernetes management, accelerated. 🚀
A GitHub Action for installing, configuring and running hardware-accelerated Android Emulators on macOS virtual machines.
ANS(Accelerated Network Stack) on DPDK, DPDK native TCP/IP stack.
- ans-tcp
- dpdk
- tcp-server
- ans
AI-powered StartUp Accelerator Engine built with Next.js, LangChain, PostgreSQL + pgvector. Upload, organize, and chat with documents. Includes predictive missing-document detection, role-based workflows, and page-level insight extraction.
The Multi-Agent Custom Automation Engine Solution Accelerator is an AI-driven system that manages a group of AI agents to accomplish tasks based on user input. Powered by Microsoft Agent Framework, Azure Foundry, Azure Cosmos DB, and infrastructure services, it provides a reference application, allowing you to hit the ground running.
- ai-azd-templates
- azd-templates
Chat and Ask on your own data. Accelerator to quickly upload your own enterprise data and use OpenAI services to chat to that uploaded data and ask questions
♾️ Private Agent Fleet with Spec Coding. Each agent gets their own GPU-accelerated desktop. Run Claude, Codex, Gemini and open models on a full private AI Stack ♾️
This guide should help fellow researchers and hobbyists to easily automate and accelerate there deep leaning training with their own Kubernetes GPU cluster.
Adlik: Toolkit for Accelerating Deep Learning Inference
Microsoft Foundry (demos, documentation, accelerators).
- azure
- azure-cognitive-services
- azure-openai
- langchain-python
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
Web application acceleration, advanced DDoS protection and web security
- web-application-firewall
- linux-kernel
- high-performance
- http-accelerator
Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, Gaudi NPU, Google TPU, GraphCore IPU and other NPUs.
Azure MLOps (v2) solution accelerators. Enterprise ready templates to deploy your machine learning models on the Azure Platform.
FairPlayCombined is a platform designed to accelerate app development using .NET, Blazor, and more. It includes real-world templates like video sharing and dating apps, reducing costs and time-to-market. Perfect for developers, startups, and businesses, it empowers innovation and delivers value with pre-built tools and resources.
- aspire
- blazor
- csharp
- dotnet