Official Inference Code of EAGLE-4
- eagle
- gpu
- llm-inference
- sglang
Repository Index
47,133 repositories indexed
97–120 of 167 · Most stars
Find the cheapest API for any model and connect it from your AI agent: Grandet Skill and an anonymous MCP server, backed by listed prices from 1,800+ official, inference and relay providers on grandet.ai.
- ai
- api-credits
- developer-tools
- free-api
Dataflow compiler for QNN inference on FPGAs
EdgeRock: Strong Reasoning at Constant Memory. Multimodal models with O(N) generation and O(1) persistent history. Inference and evaluation code.
Deep learning inference nodes for ROS / ROS2 with support for NVIDIA Jetson and TensorRT
A uniform interface to run deep learning models from multiple frameworks
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
- anthropic-api
- cuda
- gemma
- gguf
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
- cli
- deep-learning
- education
- from-scratch
Idol: a single image to 3D Gaussians. Inference SDK and demo.
The repository host gives no description.
Run many AI agents at once on your Mac, up to 3x faster.
- agents
- apple-silicon
- artificial-intelligence
- inference-acceleration
Official Hi3D v1.0: high-resolution 3D geometry refinement built on Sparc3D. Inference code, model weights, and documentation.
- 3d-generation
- image-to-3d
- geometry-refinement
- sparc3d
Remory: Learning Residual Memory for Context Compaction
- context-compaction
- inference
- llm-agents
- residual-memory
oneAPI Data Analytics Library (oneDAL)
- onedal
- data-analysis
- oneapi
- machine-learning
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
- apple-silicon
- llm
- llm-inference
- local-llm
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
- avx2
- c
- cpu-inference
- gguf
Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell
Translated斑海豹 (Spotted Seal) — Phocinae-Largha-150M-v1: a 144.3M bilingual decision model. Tiny model. Big decisions.
- bilingual
- calibration
- cpu-inference
- decision-making
Xolotl (formerly Strata-DSV4.1): run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 90 GB RAM) at up to ~27 tok/s, 512K context, October 1017 builds included. Plus GLM-5.3-Flash and Qwen3.8. MoE experts tiered across VRAM, pinned RAM and NVMe; OpenAI + Anthropic API.
AI Agent Identity and Access Management and Inference Firewall
- agent-identity
- ai-audit
- ai-firewall
- ai-gateway
🧱 Experimental library for building inference engines
🏹 Parse JSON with style
- json
- json-parsing
- ios
- swift
High-performance Bayesian Data Analysis on the GPU in Clojure
- clojure
- bayesian-inference
- bayesian-data-analysis
- gpu-computing