AirLLM 2.8T LLM inference with single 4GB GPU
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.