Repository Index

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

• python
• deep-learning
• artificial-intelligence
• ai

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

• tensorrt
• nvidia
• deep-learning
• inference

Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

• onednn
• oneapi
• performance
• cpp

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

• kv-cache
• llm-inference
• local-llm
• quantization

ThunderSVM: A Fast SVM Library on GPUs and CPUs

• classification
• regression
• one-class-learning
• cuda

ThunderGBM: Fast GBDTs and Random Forests on GPUs

• cuda
• gpu
• gbdt
• random-forest