Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
Repository Index
132,241 visible repositories in the index
361–384 of 754 · Most stars
The building blocks for your AI app.
LM Studio Apple MLX engine
- mlx
- python
Translate a whole season of subtitles in one pass — .srt/.ass/.vtt/.lrc, 120+ languages, 27 LLM providers, timing untouched | 整季字幕一次译完,时轴不动,支持 120+ 语言
- srt
- subtitles
- ass
- lrc
Enterprise-grade landing zone for AI agent applications on Azure. Deploy the secure infrastructure, the agent app, or both — built on Microsoft Foundry and Microsoft Agent Framework, with Zero-Trust networking, observability and IaC.
A minimal LLM chat app that runs entirely in your browser
KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM
- ggml
- kv-cache
- llama-cpp
- llm-inference
A desktop app that lets you use your AI subscriptions (Claude, ChatGPT, Gemini, GitHub Copilot) with any coding tool. Wraps CLIProxyAPI with a clean UI for managing connections and tracking usage.
Convos :busts_in_silhouette: is the simplest way to use IRC in your browser
- perl
- irc
- irc-client
- chat
🚀 A real-time monitoring dashboard for Claude Code & Codex, built with SQLite3, Node.js, Express, React, Vite, TailwindCSS, & WebSockets. It tracks sessions, agent activity, tool usage, and subagent orchestration, providing live analytics, a Kanban status board, status notifications, a cute buddy, & an interactive web UI/MacOS/Windows native app.
- claude-agents
- claude-code
- claude-skills
- express
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
An AI chat bot for small and medium-sized teams, supporting models such as Deepseek, Open AI, Claude, and Gemini. 专为中小团队设计的 AI 聊天应用,支持 Deepseek、Open AI、Claude、Gemini 等模型。
Inkdown is a WYSIWYG editor and an LLM dialogue tool, fully compatible with GitHub Flavored Markdown Spec.
A local-first AI knowledge base & NotebookLM alternative built with Electron.
- notebooklm
- anthropic
- electron-app
Object Detection Metrics. 14 object detection metrics: mean Average Precision (mAP), Average Recall (AR), Spatio-Temporal Tube Average Precision (STT-AP). This project supports different bounding box formats as in COCO, PASCAL, Imagenet, etc.
- metrics
- object-detection
- bounding-boxes
- pascal-voc
TurboOCR, >200 img/s OmnidocBench. TensorRT FP16, PP-OCRv6, HTTP + gRPC
Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.
- prompt-engineering
- llm
- llm-inference
- prompt
a self-hosted webui for 30+ generative ai
- bark
- controlnet
- gfpgan
- gradio
Using a Model to generate prompts for Model applications. / 使用模型来生成作图咒语的偷懒工具,支持 MidJourney、Stable Diffusion 等。
- midjourney
- midjourney-app
- prompt
- prompt-tool
The repository host gives no description.
Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.
A web application for chatting with AI characters that anyone can easily set up and deploy.
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.