High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime
- computer-vision
- executorch
- llm-inference
- object-detection
132,241 visible repositories in the index
313–336 of 748 · Most stars
High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime
This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.
A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.
Infer TS types from JSON schemas 📝
Router that virtually distributes inference across connected devices in the home.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
High-performance data-driven data specification library for Clojure/Script.
Learn LLM internals step by step - from tokenization to attention to inference optimization.
Official PyTorch inference for Breeze TTS 2
Inference Microsoft Florence2 VLM
Pure C inference of Mistral Voxtral Realtime 4B speech to text model
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Notebooks covering mathematical analysis of ZKP building blocks, algorithm implementations of various proof systems, and protocol optimization techniques.
Tigramite is a python package for causal inference with a focus on time series data. The Tigramite documentation is at
A ready-to-fork Claude Code template for academic research — papers, data analysis (R, Stata, Python), slides and teaching — with multi-agent review, enforced quality gates and replication protocols. Codex and Antigravity can use it too.
OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.
Causal Discovery in Python. Learning causality from data.
Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
Acceleration package for neural networks on multi-core CPUs
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
Reference implementations of MLPerf® inference benchmarks
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Add bisenetv2. My implementation of BiSeNet