Official Inference Code of EAGLE-4
- eagle
- gpu
- llm-inference
- sglang
Repository Index
47,133 repositories indexed
49–72 of 72 · Most stars
Dataflow compiler for QNN inference on FPGAs
EdgeRock: Strong Reasoning at Constant Memory. Multimodal models with O(N) generation and O(1) persistent history. Inference and evaluation code.
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
- cli
- deep-learning
- education
- from-scratch
Idol: a single image to 3D Gaussians. Inference SDK and demo.
Official Hi3D v1.0: high-resolution 3D geometry refinement built on Sparc3D. Inference code, model weights, and documentation.
- 3d-generation
- image-to-3d
- geometry-refinement
- sparc3d
Remory: Learning Residual Memory for Context Compaction
- context-compaction
- inference
- llm-agents
- residual-memory
Translated斑海豹 (Spotted Seal) — Phocinae-Largha-150M-v1: a 144.3M bilingual decision model. Tiny model. Big decisions.
- bilingual
- calibration
- cpu-inference
- decision-making
AI Agent Identity and Access Management and Inference Firewall
- agent-identity
- ai-audit
- ai-firewall
- ai-gateway
Run many AI agents at once on your Mac, up to 3x faster.
- agents
- apple-silicon
- artificial-intelligence
- inference-acceleration
🧱 Experimental library for building inference engines
Python package facilitating the use of Bayesian Deep Learning methods with Variational Inference for PyTorch
- bayesian-inference
- deep-learning
A fast and efficient type assistant for Python, including tensor shape inference
- python
- typing
Our lightning-fast inference engine.
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
- calibration
- cuda
- cuda-graphs
- decision-making
Probabilistic programming framework that facilitates objective model selection for time-varying parameter models.
- time-series-analysis
- model-selection
- bayesian-inference
- anomaly-detection
Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"
- diffusion-models
- efficient-inference
- high-resolution
- image-generation
A Long-Horizon Benchmark for Self-Improving Inference Systems
ReAlign models instantly, on demand. Per-request alignment for verified users and channels, or Always On. Use directly or with Hermes, OpenClaw and custom harnesses.
A CLI tool to automatically add type annotations into Python code. Must have tool for annotating existing code.
- code-formatter
- code-generation
- mypy
- pyannotate
Opinionated typing package for precise type hints in Python
- pep484
- python
- python-typing
- numpy
Inference Llama in Common Lisp
Multi-stage Riemannian flow matching for physically valid molecular docking, with GNINA scoring, PoseBusters filtering, CLI inference, and benchmarks.
- alphafold3
- docking
- drug-design
- drug-discovery
Inference of probabilistic schedules from empirical data about transit vehicles.