1.vllm-project / vllmA high-throughput and memory-efficient inference and serving engine for LLMsgptllmpytorchmodel-servingtransformerllm-serving+14 morePythonAPACHE-2.096K total24K forks+17,617 starsfrom 78,461 · score 9.78
2.kitops-ml / kitopsAn open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.aicodedatasetsdevopsdevops-toolsml+14 moreGoAPACHE-2.01.4K total188 forks+106 starsfrom 1,332 · score 4.67
3.tensorchord / envd🏕️ Reproducible development environment for humans and agentsdeveloper-toolsdevelopment-environmentdockerbuildkithacktoberfestllmops+6 moreGoAPACHE-2.02.2K total169 forks+53 starsfrom 2,188 · score 3.99
4.logicalclocks / hopsworksHopsworks - Data-Intensive AI platform with a Feature Storefeature-storeawsazuredata-sciencefeature-engineeringfeature-management+11 moreJavaAGPL-3.01.3K total159 forks+23 starsfrom 1,288 · score 3.18