State of the art inference performance with modern accelerators on Kubernetes
Repository Index
107,098 visible repositories in the index
121–144 of 678 · Most stars
A PyTorch Library for Accelerating 3D Deep Learning Research
- pytorch
- 3d-deep-learning
- neural-networks
- differentiable-rendering
CommonMark spec, with reference implementations in C and JavaScript
An easy to use PyTorch to TensorRT converter
- jetson-nano
- jetson-tx2
- jetson-xavier
- pytorch
Universal and Transferable Attacks on Aligned Language Models
A unified inference and post-training framework for accelerated video generation.
- diffusers
- diffusion-models
- video-generation
- distillation
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
- chinese
- english
- multilingual
- realtime
A fast inference library for running LLMs locally on modern consumer-class GPUs
Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference
A collection of IPA files from many different sources, for TrollStore!
Villain is a high level stage 0/1 C2 framework that can handle multiple reverse TCP & HoaxShell-based shells, enhance their functionality with additional features (commands, utilities) and share them among connected sibling servers (Villain instances running on different machines).
- open-source
- pentest
- pentesting
- readteaming
Pre-trained Deep Learning models and demos (high quality and extremely fast)
- models
- caffemodel
- demo
- tensorflow-models
Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
- convolutional-neural-networks
- efficient-inference
- imagenet
- model-compression
Bazarr is a companion application to Sonarr and Radarr. It manages and downloads subtitles based on your requirements. You define your preferences by TV show or movie and Bazarr takes care of everything for you.
- sonarr
- subliminal
- subtitle-downloader
- radarr
[CAAI AIR'24] Bilateral Reference for High-Resolution Dichotomous Image Segmentation
- dichotomous-image-segmentation
- salient-object-detection
- camouflaged-object-detection
- background-removal
A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Optimizing inference proxy for LLMs
- agent
- agentic-ai
- agentic-workflow
- agents
Web-based SQLite database browser written in Python
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
- apple-silicon
- local-llm
- macos
- mlx
算法/数据结构/Python/剑指offer/机器学习/leetcode
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
- federated-learning
- deep-learning
- distributed-training
- edge-ai
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
- ai
- api
- serving
- artificial-intelligence