1.bentoml / OpenLLMRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.llmllmopsmodel-inferencefine-tuningllm-servingllama+12 morePythonAPACHE-2.013K total849 forks+337 starsfrom 12,238 · score 5.82