The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Repository Index
47,133 repositories indexed
1–10 of 10 · Most stars
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
- accelerator
- ai-infra
- ai-infrastructure
- book
eBPF Observability - Distributed Tracing and Profiling
🛠 All-in-one web-based IDE specialized for machine learning and data science.
eBPF based always-on CPU/GPU profiler auto-discovering targets in Kubernetes and systemd, zero code changes or restarts needed!
Powerful Powerful Machine Learning library with GPU, CPU and WASM backends
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Raspberry Pi's CPU and GPU temperature exporter for Prometheus consumption.
- exporter
- monitoring
- prometheus
- raspberry-pi
Lightweight Docker monitoring dashboard with anomaly detection & Telegram alerts. One-liner install, zero config.