1.bentoml / OpenLLMRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.llmllmopsmodel-inferencefine-tuningllm-servingllama+12 morePythonAPACHE-2.013K total849 forks+8 starsfrom 12,567 · score 2.20