Sign in

Repository Index

142,273 visible repositories in the index

Tags: LLM observability
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–21 of 21 · Most stars

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

  • agentneo
  • agents
  • ai-performance-optimization
  • llm-testing

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

A context insight plugin officially recommended by DeepSeek Harness, for context composition, evolution and Multi-Agent details. DeepSeek Harness官方推荐的上下文洞察插件,透视上下文组成与演进,以及多Agent 协作与通讯。

  • dsh-external
  • dsh-plugin
  • dsh-plugins
  • cordis-plugin

🚀 A real-time monitoring dashboard for Claude Code & Codex, built with SQLite3, Node.js, Express, React, Vite, TailwindCSS, & WebSockets. It tracks sessions, agent activity, tool usage, and subagent orchestration, providing live analytics, a Kanban status board, status notifications, a cute buddy, & an interactive web UI/MacOS/Windows native app.

A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.

  • ai-gateway

Modern web console for CLIProxyAPI v8+ with provider and OAuth management, live routing, request analytics, pricing, and MCP.

  • ai-gateway
  • cliproxyapi
  • cpa
  • dashboard

Calibrated internal-state modulation, readout, and neural observability for local dense language models.

  • activation-steering
  • affective-computing
  • embodied-ai
  • gemma

OpenTelemetry-native tracing, token tracking, cost attribution, and prompt analytics for Go backends integrating LLMs.