1.bentoml / OpenLLMRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.llmllmopsmodel-inferencefine-tuningllm-servingllama+12 morePythonAPACHE-2.013K total849 forks+35 starsfrom 12,540 · score 3.58