1.vllm-project / vllmA high-throughput and memory-efficient inference and serving engine for LLMsgptllmpytorchmodel-servingtransformerllm-serving+14 morePythonAPACHE-2.096K total24K forks+3,124 starsfrom 92,954 · score 8.05
2.kitops-ml / kitopsAn open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.aicodedatasetsdevopsdevops-toolsml+14 moreGoAPACHE-2.01.4K total188 forks+15 starsfrom 1,423 · score 2.77
3.tensorchord / envd🏕️ Reproducible development environment for humans and agentsdeveloper-toolsdevelopment-environmentdockerbuildkithacktoberfestllmops+6 moreGoAPACHE-2.02.2K total169 forks+6 starsfrom 2,235 · score 1.95
4.logicalclocks / hopsworksHopsworks - Data-Intensive AI platform with a Feature Storefeature-storeawsazuredata-sciencefeature-engineeringfeature-management+11 moreJavaAGPL-3.01.3K total159 forks+3 starsfrom 1,308 · score 1.39