Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.
- cuda
- desktop-app
- gguf
- llm
132,241 visible repositories in the index
3,313–3,336 of 3,504 · Most stars
Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.
Agent Speed — A lightweight, real-time token speed monitor for Codex and Claude Code. Track tokens per second (TPS), detect slowdowns, and monitor AI agent performance at a glance.
TranslatedAcademic research library for DSH — search, cite, approve imports, hand off notes. Also: a research literature library plugin for DeepSeek Harness: search papers, include sources, approve imports into the library, and hand off note leads to other plugins in the same session.
Go AI SDK, the Go way. One unified API across 21+ providers. Streaming, structured output, MCP support, stdlib only. Go AI SDK for AI applications inspired by Vercel AI SDK.
WorkBuddy2API-Hub - OpenAI-compatible local gateway
A DeepSeek Harness (dsh) plugin — turns dsh web into a SillyTavern-style roleplay frontend: character cards, prompt presets, lorebooks, personas, BM25 long-term memory, world-state deltas, and rollback-able floor operations, all on the dsh agent runtime.
StateTrack
Feather agent harness, training integrations, and evaluation tools for knowledge work
A minimalistic C++ Jinja templating engine for LLM chat templates
Reproducible Docker/vLLM deployment, tuning, and benchmarks for DeepSeek V4.1 Flash on a switchless three-node or four-node DGX Spark fabric.
SurveyGraph
Free AI models for every coding tool — a local OpenAI-compatible gateway for Claude Code, Codex, Cursor, Cline and OpenCode. Based on 9router (MIT).
Fast, cross-platform, real-time token usage tracker and cost monitor for Claude Code / Codex CLI / Antigravity CLI / Qwen Code / Cline / Zoo Code / Kilo Code / GitHub Copilot / OpenCode / Pi Agent / Piebald.
A ~45 MB MaaS platform: one cluster across public and private clouds, on any mix of accelerators.
Uncensored AI API and models — one key for Claude, GPT, Gemini, Grok, DeepSeek, GLM and Kimi, with uncensored and abliterated variants where available. OpenAI- and Anthropic-compatible. Pay per token.
TranslatedChinese edition of an AI reference image gallery | Costumes (1,407 realistic sets / 1,320 animation sets), 1,499 face shapes, 1,439 pose line drawings and 1,439 depth maps, 843 anime-style (二次元) entries. Designed for AI painting, character design, and comic-drama storyboards, with support for Chinese search, multi-angle browsing, and image copying and downloading. Open-source static site that preserves the original sources and terms of use.
The repository host gives no description.
This is the official repo for paper InteractiveWorld A Verifiable Human-Centric Environment for Building Better Interactive MLLM Assistants
llama.cpp fork that abliterates at inference
Cross-platform desktop LLM client for OpenAI ChatGPT, DeepSeek R1, Anthropic Claude and more, with a focus on privacy and security.
A 9-billion-parameter language model running on a PS4 GPU. Offline.
Serum 2 2026 standalone bundle with full plugin suite, multitrack editor, bundled instruments and portable offline mode for Windows 11
The repository host gives no description.
SkyDot: self-hosted personal AI assistant and team workbench