Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
Repository Index
142,187 visible repositories in the index
1,681–1,704 of 3,907 · Most stars
The building blocks for your AI app.
A modular RAG (Retrieval-Augmented Generation) system with MCP Server architecture. Using Skill to make AI follow each step of the spec and complete the code 100% by AI.
LM Studio Apple MLX engine
- mlx
- python
High-fidelity performance metrics for generative models in PyTorch
Translate a whole season of subtitles in one pass — .srt/.ass/.vtt/.lrc, 120+ languages, 27 LLM providers, timing untouched | 整季字幕一次译完,时轴不动,支持 120+ 语言
- srt
- subtitles
- ass
- lrc
A minimal LLM chat app that runs entirely in your browser
Enterprise-grade landing zone for AI agent applications on Azure. Deploy the secure infrastructure, the agent app, or both — built on Microsoft Foundry and Microsoft Agent Framework, with Zero-Trust networking, observability and IaC.
General purpose unsupervised sentence representations
A generalized information-seeking agent system with Large Language Models (LLMs).
- agi
- autogpt
- autonomous-agents
- chatgpt
Multilingual word vectors in 78 languages
- word-vectors
- machine-learning
- machine-translation
- natural-language-processing
A repository of Generative AI prompts for product managers using agents such as ChatGPT, Claude, & Gemini
KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM
- ggml
- kv-cache
- llama-cpp
- llm-inference
A desktop app that lets you use your AI subscriptions (Claude, ChatGPT, Gemini, GitHub Copilot) with any coding tool. Wraps CLIProxyAPI with a clean UI for managing connections and tracking usage.
A school for camelids
TypeScript AI platform with AI chat, Autonomous agents, Software developer agents, chatbots and more
Run, serve, query and edit AI models — a Rust model runtime built on VINDEX3, an executable, inspectable model format.
- huggingface
- inference
- llm
- mechanistic-interpretability
Convos :busts_in_silhouette: is the simplest way to use IRC in your browser
- perl
- irc
- irc-client
- chat
Formerly Better Chatbot. Navigator is an open-source AI workspace for agents, MCP and workflow automation.
An open-source, ontology-based semantic context accelerator that enables AI agents to make more accurate, consistent, and explainable decisions.
🚀 A real-time monitoring dashboard for Claude Code & Codex, built with SQLite3, Node.js, Express, React, Vite, TailwindCSS, & WebSockets. It tracks sessions, agent activity, tool usage, and subagent orchestration, providing live analytics, a Kanban status board, status notifications, a cute buddy, & an interactive web UI/MacOS/Windows native app.
- claude-agents
- claude-code
- claude-skills
- express
LLM powered development for Neovim
- neovim
- neovim-plugin
- lua
TranslatedOne-click replacement of the built-in prompts of four AI clients: DSH / WorkBuddy / ZCode / Codex. Double-click to use, self-verifiable, backs up before changes, one-click restore. A single-file exe that needs no Python installation, open source under the MIT license; activation codes are used for server operation and maintenance, and are issued through self-service on the official website.
- deepseek-harness
- persona
- python
- windows
明医 (MING):中文医疗问诊大模型
- medical
- pytorch
- transformers
- llm