1.vllm-project / vllmA high-throughput and memory-efficient inference and serving engine for LLMsgptllmpytorchmodel-servingtransformerllm-serving+14 morePythonAPACHE-2.096K total24K forks+8,314 starsfrom 87,764 · score 9.03
2.kitops-ml / kitopsAn open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.aicodedatasetsdevopsdevops-toolsml+14 moreGoAPACHE-2.01.4K total188 forks+46 starsfrom 1,392 · score 3.85
3.tensorchord / envd🏕️ Reproducible development environment for humans and agentsdeveloper-toolsdevelopment-environmentdockerbuildkithacktoberfestllmops+6 moreGoAPACHE-2.02.2K total169 forks+28 starsfrom 2,213 · score 3.37
4.logicalclocks / hopsworksHopsworks - Data-Intensive AI platform with a Feature Storefeature-storeawsazuredata-sciencefeature-engineeringfeature-management+11 moreJavaAGPL-3.01.3K total159 forks+12 starsfrom 1,299 · score 2.56