Repository Index

The open-source AI voice studio. Clone, dictate, create.

• ai
• voice-clone
• qwen3-tts
• voice-ai

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

• blackwell
• cuda
• moe
• pytorch

NumPy & SciPy for GPU

• cuda
• cudnn
• cublas
• cusolver

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

• amd
• cuda
• inference
• kv-cache

NumPy aware dynamic Python compiler using LLVM

• python
• numpy
• llvm
• compiler

NVIDIA cuML: GPU-Accelerated Machine Learning

• machine-learning-algorithms
• machine-learning
• cuda
• gpu

Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.

• nvr
• network-video-capture
• network-video-recorder
• tensorflow

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

• kv-cache
• llm-inference
• local-llm
• quantization

Turkish voice design with VoxCPM2 on a 4 GB GPU: describe a voice, pick a variant, read text in 30 languages. Patched audio.cpp, local UI in 30 languages, 14 ready-made voices.

• cuda
• ggml
• low-vram
• speech-synthesis

Fish Audio Drama 3 text-to-speech on the TensorFold native CUDA engine for DGX Spark (GB10): recipe, engine patches, benchmarks. Built with Fish Audio.