Official inference library for pre-processing of Mistral models
Repository Index
132,241 visible repositories in the index
1–4 of 4 · Most stars
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.
GPU worker client for the Talos network. Pairs with your Talos account, serves open-model inference jobs over a WebSocket, and reports uptime for payouts.