1.vllm-project / vllmA high-throughput and memory-efficient inference and serving engine for LLMsgptllmpytorchmodel-servingtransformerllm-serving+14 morePythonAPACHE-2.096K total24K forks+593 starsfrom 95,485 · score 6.39
2.kitops-ml / kitopsAn open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.aicodedatasetsdevopsdevops-toolsml+14 moreGoAPACHE-2.01.4K total188 forks+4 starsfrom 1,434 · score 1.61
3.tensorchord / envd🏕️ Reproducible development environment for humans and agentsdeveloper-toolsdevelopment-environmentdockerbuildkithacktoberfestllmops+6 moreGoAPACHE-2.02.2K total169 forks+2 starsfrom 2,239 · score 1.10