NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
Repository Index
65,764 visible repositories in the index
505–528 of 663 · Most stars
A free AI assistant and survival library that runs on your own computer, with no internet needed. Shows the source of every answer.
Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)
- calibration
- decision-model
- jev
- jev-model
A Utility CLI for AI Coding Agents
Source-available agent platform for Global × China enterprises — wire every system through one agent core. Self-hosted, any LLM.
The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
Local CLI Copilot, powered by Ollama. 💻🦙
💃 Dance with Intelligence in Your Code. Minuet offers code completion as-you-type from popular LLMs including OpenAI, Gemini, Claude, Ollama, Llama.cpp, Codestral, and more.
traceroot: the open-source platform that continuously improves your ai agents.
- observability
- agent-observability
- agentic
- ai-observability
Gp.nvim (GPT prompt) Neovim AI plugin: ChatGPT sessions & Instructable text/code operations & Speech to text [OpenAI, Ollama, Anthropic, ..]
Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
- amd
- gfx1151
- gpu-inference
- hip
Complete logs of the experiments in the blog post 'LLMs can understand and write neural network weights'
TranslatedAI Cross-Border E-commerce Operations Agent Toolkit · Breaks operations SOPs down into 7 reusable AI Agent workflows, including prompts, templates, and real-world cases
The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary, with OpenAI-compatible APIs, caching for coding agents and model extensions. Linux and Windows.
- amd
- llm
- strix-halo
- gfx1151
TranslatedOne-click replacement of the built-in prompts of four AI clients: DSH / WorkBuddy / ZCode / Codex. Double-click to use, self-verifiable, backs up before changes, one-click restore. A single-file exe that needs no Python installation, open source under the MIT license; activation codes are used for server operation and maintenance, and are issued through self-service on the official website.
- deepseek-harness
- persona
- python
- windows
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).
Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.
- ai-gateway
- anthropic
- claude-code
- codex
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
- anthropic-api
- cuda
- gemma
- gguf
An open-source take on ChatGPT's Intelligent UI: answers stream as interactive UI (maps, photos, charts, drawings and working tools). Built with OpenUI.
Native vLLM serving for Jev decision models
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.
Reusable prompts for a structured, evidence-first bug bounty hunting workflow
- application-security
- bug-bounty
- bug-bounty-hunting
- cybersecurity
FactCircuit: an auditable claim-and-evidence verification loop with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.
- accuracy-decline
- ai-safety
- audit-trail
- fact-checking