Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.
Repository Index
132,241 visible repositories in the index
625–648 of 748 · Most stars
Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster than Python inference.
- c99
- catboost
- compiler
- decision-trees
NicheNet: predict active ligand-target links between interacting cells
- single-cell-omics
- intercellular-communication
- ligand-receptor
- ligand-target
Inferring CNV from Single-Cell RNA-Seq
Official inference code for BluePixel, a native 4K image editing model with 4-step distilled inference, built on FLUX.2 Klein and DCAE.
- diffusion-models
- flux
- image-editing
- image-to-image
A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
Real-time 3D multi-person pose estimation demo in PyTorch. OpenVINO backend can be used for fast inference on CPU.
- human-pose-estimation
- real-time
- 3d-human-pose
- multi-person-pose-estimation
Doing Bayesian Data Analysis, 2nd Edition (Kruschke, 2015): Python/PyMC3 code
- bayesian-data-analysis
- bayesian-inference
- pymc3
- mcmc
Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
Python Causal Impact Implementation Based on Google's R Package. Built using TensorFlow Probability.
- causalimpact
- tensorflow-probability
- python
- causal-inference
Train a state-of-the-art yolov3 object detector from scratch!
- yolov3
- yolo
- object-detection
- python
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Gaussian processes in JAX and Equinox.
- gaussian-processes
- jax
- probabilistic-programming
- bayesian-inference
[NeurIPS 2022] Denoising Diffusion Restoration Models -- Official Code Repository
- diffusion
- deblurring
- diffusion-models
- inpainting
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
- apple-silicon
- llm
- llm-inference
- local-llm
Real-time portrait segmentation for mobile devices
- portrait-segmentation
- keras
- tensorflow
- android
DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
Sybil-resistant AI agent network with hardware-attested identity. Proof-of-Antiquity blockchain: physical machines across 15+ CPU architectures prove they are real silicon, not VM farms. Agent economy, micropayments, Solana bridge (wRTC). $0 VC.
- blockchain
- cryptocurrency
- mining
- vintage-hardware
LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis
- llama
- llm
- text-to-speech
- xcodec2
Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.
A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
R package to compute and plot predictions, slopes, marginal means, and comparisons (contrasts, risk ratios, odds, etc.) for over 100 classes of statistical and ML models. Conduct linear and non-linear hypothesis tests, or equivalence tests. Calculate uncertainty estimates using the delta method, bootstrapping, or simulation-based inference
PyTensor allows you to define, optimize, and efficiently evaluate mathematical expressions involving multi-dimensional arrays.
- ai
- bayesian-inference
- computational-science
- deep-learning