Repository Index

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

• llama
• ai
• llm
• stable-diffusion

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

• model-serving
• mlops
• llmops
• generative-ai

All-in-One Development Tool based on PaddlePaddle

• classification
• segmentation
• deployment
• ocr

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

• knative
• machine-learning
• model-interpretability
• model-serving

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

• federated-learning
• deep-learning
• distributed-training
• edge-ai

Stable diffusion for real-time music generation

• diffusion
• ai
• audio
• music

Deep Learning Server and CLI for Torch and TensorRT

• deep-learning
• machine-learning
• caffe
• xgboost

Turn any computer or edge device into a command center for your computer vision projects.

• computer-vision
• inference-api
• inference-server
• vit