Tensors and Dynamic neural networks in Python with strong GPU acceleration
- neural-network
- autograd
- gpu
- numpy
Repository Index
47,133 repositories indexed
1–24 of 27 · Most stars
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Machine Learning Engineering Open Book
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
- llm
- plm
- pre-trained-language-models
- alpaca
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Open Machine Learning Compiler Framework
- compiler
- tensor
- deep-learning
- gpu
NumPy & SciPy for GPU
- cuda
- cudnn
- cublas
- cusolver
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
- cloud-computing
- deep-learning
- gpu
- hyperparameter-tuning
High-performance TensorFlow library for quantitative finance.
NVIDIA cuML: GPU-Accelerated Machine Learning
- machine-learning-algorithms
- machine-learning
- cuda
- gpu
A highly efficient implementation of Gaussian Processes in PyTorch
- pytorch
- gaussian-processes
- gpu-acceleration
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction of AlphaFold 2
- pytorch
- protein-structure
- alphafold2
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
- kv-cache
- llm-inference
- local-llm
- quantization
GPU-Accelerated Deep Learning Library in Python
DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome
- kmer
- dnabert-model
- kmer-format
- gpu
Local AI BGM and sound effects for Claude Code and any MCP client. Stable Audio 3 on Apple Silicon (MLX) and Windows NVIDIA GPUs (PyTorch). No cloud, no API key.
- apple-silicon
- audio-generation
- claude-code
- game-audio
Turkish voice design with VoxCPM2 on a 4 GB GPU: describe a voice, pick a variant, read text in 30 languages. Patched audio.cpp, local UI in 30 languages, 14 ready-made voices.
- cuda
- ggml
- low-vram
- speech-synthesis
🧱 Experimental library for building inference engines
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
- calibration
- cuda
- cuda-graphs
- decision-making
Generative Fill, Remove object, Generative Expand and Text to Image for PhotoCraft and GIMP 3. Free, local, on your own GPU through ComfyUI.
- generative-ai
- gimp-3
- gimp-plugin
- photo-editing
A Genetic Programming platform for Python with TensorFlow for wicked-fast CPU and GPU support.