Inference and training library for high-quality TTS models.
Repository Index
111,085 visible repositories in the index
73–96 of 315 · Most stars
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
- flash-attention
- paged-attention
- tensorrt-llm
- vllm
Markdown Presentations for Tech Conferences, Training, Developer Advocates, and Educators.
Superduper: End-to-end framework for building custom AI applications and agents.
- ai
- mlops
- torch
- transformers
State of the art inference performance with modern accelerators on Kubernetes
An easy to use PyTorch to TensorRT converter
- jetson-nano
- jetson-tx2
- jetson-xavier
- pytorch
A unified inference and post-training framework for accelerated video generation.
- diffusers
- diffusion-models
- video-generation
- distillation
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
- chinese
- english
- multilingual
- realtime
A fast inference library for running LLMs locally on modern consumer-class GPUs
Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference
Pre-trained Deep Learning models and demos (high quality and extremely fast)
- models
- caffemodel
- demo
- tensorflow-models
Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
- convolutional-neural-networks
- efficient-inference
- imagenet
- model-compression
A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Optimizing inference proxy for LLMs
- agent
- agentic-ai
- agentic-workflow
- agents
Hypergraph is more powerful. Transform unstructured text into structured knowledge with LLMs. Graphs, hypergraphs, and spatio-temporal extractions — with one command.
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
- apple-silicon
- local-llm
- macos
- mlx
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
- federated-learning
- deep-learning
- distributed-training
- edge-ai
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
- ai
- api
- serving
- artificial-intelligence
State-of-the-art LLM compression, built for production inference with vLLM
- compression
- quantization
TurboDiffusion: 100–200× Acceleration for Video Diffusion Models
- ai-infra
- diffusion-models
- inference-acceleration
- rcm
The repository provides code for running inference with the Meta Segment Anything Audio Model (SAM-Audio), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
The repository provides code for running inference with the SAM 3D Body Model (3DB), links for downloading the trained model checkpoints and datasets, and example notebooks that show how to use the model.