Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Repository Index
47,133 repositories indexed
1–16 of 16 · Most stars
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
🚀 A real-time monitoring dashboard for Claude Code & Codex, built with SQLite3, Node.js, Express, React, Vite, TailwindCSS, & WebSockets. It tracks sessions, agent activity, tool usage, and subagent orchestration, providing live analytics, a Kanban status board, status notifications, a cute buddy, & an interactive web UI/MacOS/Windows native app.
- claude-agents
- claude-code
- claude-skills
- express
React design system for agentic interfaces. Every free BoardUI component as source, with a working AI chat app on your own model key as the homepage.
Track AI API quotas across Synthetic, Z.ai, Anthropic (Claude Code), Codex, GitHub Copilot & Antigravity in real time. Lightweight background daemon (<50MB RAM), SQLite storage, Material Design 3 dashboard. Zero telemetry.
- developer-tools
- golang
- quota-tracker
- ai-api-monitoring
TranslatedQoder international and China multi-account reverse proxy gateway, a multi-account OpenAI-compatible gateway hub for Qoder's international and China dual regions — COSY-signed inference, stable device fingerprints to avoid risk control, OAuth device authorization for client-free login, daily check-in and Pro benefits, background scheduled task scheduler, web monitoring dashboard, supporting Codex / Claude Code and standard OpenAI clients
TranslatedAccount management center for new-api / sub2api relay stations: balance, API Key, usage, rate multipliers, model price comparison | https://nvcenter.cc
- api-key-management
- api-relay
- claude
- dashboard
Evolved DSH plugin harnesses for five agent benchmarks, with versioned artifacts, evolution curves and Life-Harness comparisons
- agent-benchmark
- dsh
- harness
- leaderboard
See what your AI coding agent is doing. Multi-provider assistant & session monitor for VS Code and the terminal — inline completions, code transforms, and a full TUI dashboard tracking tokens, cost, and context across Claude Code, OpenCode, and Codex. Switch between multiple Claude Code and Codex accounts.
- copilot-alternative
- inline-completion
- claude-code-cli
- code-reviews
TranslatedOpen-source unified usage dashboard for Claude — track tokens, quota, costs across Claude Code, claude.ai & API in one panel. Suitable for Pro/Max subscribers and developers. https://dyp23yngrtumg.ok.kimi.link
CLI for managing AI agent squads. Status, memory, goals, feedback, and dashboard for your autonomous agents.
Self-hosted browser terminal manager for AI coding agents. Control Claude Code, Codex, Gemini, and shell sessions from your phone or browser over Tailscale.
MicroPython LoRa EBYTE E220 LLCC68 device library complete and tested with Arduino, esp8266, esp32, STM32 and Raspberry Pi Pico (rp2040 boards).
- arduino
- arduino-samd-boards
- e220
- ebyte
Claude Code dashboard: see where your limits are headed before you hit them. Calibrated usage forecasts, live rate-limit gauges, session costs, memory browser. Single binary, zero config, plus a VS Code extension.
Neovim plugin for automaticaly passing extra context for LLM on code snippet copy to clipboard