Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
Repository Index
138,199 visible repositories in the index
1–15 of 15 · Most stars
All-in-One Development Tool based on PaddlePaddle
- classification
- segmentation
- deployment
- ocr
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
- knative
- machine-learning
- model-interpretability
- model-serving
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
- kubernetes
- machine-learning
- deployment
- serving
TranslatedOffline translation model server with low resource consumption, fast speed, and private deployment capability.
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
- federated-learning
- deep-learning
- distributed-training
- edge-ai
🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more.
- fastapi
- streamlit
- pydantic
- python
Turn any computer or edge device into a command center for your computer vision projects.
- computer-vision
- inference-api
- inference-server
- vit
Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
Machine Learning Platform and Recommendation Engine built on Kubernetes
ModelFox makes it easy to train, deploy, and monitor machine learning models.
- rust
- machine-learning
- elixir
- elixir-lang
Deploy a ML inference service on a budget in less than 10 lines of code.
Boosting your Web Services of Deep Learning Applications.
- deep-learning
- web
- pytorch
- model-deployment
:smiley_cat: Pretty & simple image classifier app template. Deploy your own trained model or pre-trained model (VGG, ResNet, Densenet) to a web app using Flask in 10 minutes.
CodeProject.AI Server is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.