High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
Repository Index
111,821 visible repositories in the index
97–120 of 315 · Most stars
SoulX-Podcast is an inference codebase by the Soul AI team for generating high-fidelity podcasts from text.
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
巡风是一款适用于企业内网的漏洞快速应急,巡航扫描系统。
- security
- pentesting
- infosec
- exploits
Official codebase for "Self Forcing: Bridging Training and Inference in Autoregressive Video Diffusion" (NeurIPS 2025 Spotlight)
Hummingbird compiles trained ML models into tensor computation for faster inference.
Parse MySQL binlog to SQL you want
- binlog
- flashback
- mysql
Open-source inference server and production cluster for all the models your agent needs.
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
Vietnamese TTS with instant voice cloning • On-device • Real-time CPU inference • 48kHz audio quality • Chuyển văn bản thành giọng nói tiếng Việt • Text to speech tiếng Việt • TTS tiếng Việt
- deep-learning
- text-to-speech
- on-device-ml
- real-time
Patch PE, ELF, Mach-O binaries with shellcode new version in development, available only to sponsors
- file-infector
- bdf
- python
- capstone
Python Toolkit for Causal and Probabilistic Reasoning
- python
- bayesian-networks
- causal-inference
- causal-discovery
A web app for ranking computer science departments according to their research output in selective venues, and for finding active faculty across a wide range of areas.
- computer-science
- ranking
- computer-science-rankings
- faculty
Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.
- diffusion-models
- inference
- minimax-h3
- video-generation
Official implementation of CVPR2020 paper "VIBE: Video Inference for Human Body Pose and Shape Estimation"
- video-pose-estimation
- 3d-pose-estimation
- human-pose-estimation
- smpl
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
- ai
- containers
- cuda
- hip
Community maintained hardware plugin for vLLM on Huawei Ascend
PyTorch native quantization for training and inference
- brrr
- dtypes
- inference
- mx
Lightweight Image Video Action Generation Inference Framework
- video-generation
- wan-video
- diffusion-models
- auto-regressive-diffusion-model
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
Minkowski Engine is an auto-diff neural network library for high-dimensional sparse tensors
- neural-network
- computer-vision
- sparse-tensors
- convolutional-neural-networks
J-Space Cognition Suite — a model-agnostic inference-time control suite for deep reasoning, long-horizon work, verification, and recovery. Based on Anthropic's J-space global workspace research.
TokenSpeed is a speed-of-light LLM inference engine.
Official inference repo for FLUX.2 models