1.bentoml / OpenLLMRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.llmllmopsmodel-inferencefine-tuningllm-servingllama+12 morePythonAPACHE-2.013K total849 forks+161 starsfrom 12,414 · score 5.09