Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Repository Index
132,241 visible repositories in the index
121–144 of 172 · Most stars
本地优先的多模型 AI 图片生成工作台,支持 GPT Image、Gemini、图像编辑、素材库、模板与并发任务。Local-first AI image workbench for GPT Image & Gemini, with editing, reusable assets, templates and task history.
13 curated Agent Skills for research, product decisions, decks, publishing, audits, and more — portable across skills-compatible agents.
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Agent Skill that transforms AI assistants into expert economics paper writers. Synthesizes 50+ guides by Cochrane, McCloskey, Shapiro, Head, Bellemare, Goldin, Kremer. Compatible with Claude Code and OpenAI Codex.
- academic-writing
- agent-skills
- ai
- claude-code
An interactive app that walks through every stage of the LLM pipeline, from pattern matching to training a transformer from scratch, with working code you can run locally.
High-performance Text-to-Speech server with OpenAI-compatible API, 8 voices, emotion tags, and modern web UI. Optimized for RTX GPUs.
- ai-text-to-speech
- ai-voice
- artificial-intelligence
白箱AGI架构探索:元认知(自我认知循环)、持续学习(知识飞轮)、世界模型(条件空间+语义时空图)、自我改进(自举纪律)、零LLM白箱管线与可审计信任护栏。
- dsh-plugin
- mcp
- multi-agent
- knowledge-graph
Web-based Gemini models wrapped into an OpenAI-compatible API.
Use Claude Code with your ChatGPT, Kimi, Cursor or Grok subscription via a local Anthropic-compatible proxy
Android accessibility service for AI-powered text transformation
Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, etc.)
Analyzing Hacker News discussions from a decade ago in hindsight with LLMs
A Spring AI library that brings Claude Code-inspired tools and agent skills to your AI applications.
Repo for "Adaptation of Agentic AI"
- adaptation
- agentic-ai
- large-language-models
CLI, SDK, and IDE plugins for Duel Agents
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
A comprehensive collection of AI development patterns for building software with AI assistance, organized by implementation maturity and development lifecycle phases. Includes Foundation, Development, and Operations patterns with practical examples and anti-patterns.
- ai-assisted-coding
- ai-development
- ai-tools
- artificial-intelligence
An unofficial collection of Plugins for ChatGPT, in any programming language!
Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.
The unofficial OpenAI SDK for Dart & Flutter. Full API coverage + OpenAI-compatible providers (Azure, DeepSeek, LM Studio, Ollama): Responses, Chat, Realtime, Videos, Batch, Fine-tuning.
- dart
- dart-library
- dart-package
- dartlang
🪐 HelixWorld: real-time interactive audio-visual world model.
- audio-visual
- generative-ai
- realtime
- spatial-audio
<10 MB — self-hosted AI novel writer in a single Go binary with a web UI. Turn ideas into outlines and chapters with review, foreshadowing, fact-checking, and full-book polish. OpenAI-compatible APIs; Chinese & English.
- agent
- ai-writing
- creative-writing
- fiction-writing
ccteam turns the coding agents you already run (Claude Code, Codex, Grok, DeepSeek Harness, Kimi, Pi) into one team — any session can spawn, dispatch, and collect work from any vendor on any machine, while you steer it all from Telegram, Lark, or a browser tab. 把你在用的编程 agent 编成一支团队,跨厂商跨机器派活,Telegram/飞书/网页统一指挥。