LLM and agent evaluation for Java & Kotlin. Runs in JUnit and CI. Spring AI, LangChain4j, Koog, Embabel, and any LLM client.
- agent-evaluation
- evaluation-framework
- evaluation-metrics
- java
Repository Index
47,133 repositories indexed
169–190 of 190 · Most stars
PHP client for the Anthropic API: messages, streaming, tool use, thinking, web search, code execution, batches, and more.
One local, searchable index of your AI coding-agent history Claude Code, Codex, Cursor, Gemini & more. Keyword + semantic search, MCP server, CLI & VS Code extension.
TranslatedA Chinese-language guide to digital subscriptions and AI tools, including subscription instructions, risk warnings, and an FAQ.
Test harness for voice agents. Import from Retell, VAPI, Bland, LiveKit. Run autonomous simulations. Evaluate with LLM judges.
- bland
- dspy
- livekit
- llm
Local-first policy gateway for coding agents. Allow, review, or block MCP, shell, SQL, GitHub, and HTTP actions with scoped credentials and signed evidence.
- golang
- observability
- opentelemetry
- policy-engine
The tested, tool-agnostic AGENTS.md kit — verified templates, a CI linter, and migrators from .cursorrules/CLAUDE.md/Copilot/Windsurf/Cline/Aider.
Catch your AI agents when they lie about what they shipped — verifies claims against git instead of believing the agent.
- agent-orchestration
- cli
- developer-tools
- llm-agents
🧭 Let your coding agent off the leash — not off the rails. Guardrails, a hard budget cap & a self-fixing PR loop for Claude Code / Codex / Gemini. Eval-gated 100/100, you always merge.
The E2E AI testing tool | No ML Overhead
Deterministic quality scorer for AI agent instruction files — 8-dimension scoring with security, multi-format (SKILL.md, CLAUDE.md, .cursorrules, AGENTS.md), anti-gaming detection, zero dependencies
- autoresearch
- claude-code
- cli
- developer-tools
AI-Driven Full-Text Screening and Data Extraction for Systematic Reviews and Evidence Synthesis
- academic-research
- ai-assistant
- ai-tool
- data-extraction
Claude Code dashboard: see where your limits are headed before you hit them. Calibrated usage forecasts, live rate-limit gauges, session costs, memory browser. Single binary, zero config, plus a VS Code extension.
Local-only observability for AI agents on your machine. One timeline across coding and non-coding agents.
- ai-agents
- claude-code
- cli
- cursor
Native macOS app for tracking Claude Code usage — tokens, cost, rate-limit pacing, per-project breakdowns. SwiftUI + SwiftData.
Effortless Natural Language Generation: Ollama, Anthropic (Calude), ChatGTP
The EU & UK compliance plane for Google ADK.
Open-source simulation harness for testing AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.
- ai-agents
- ai-testing
- llm
- llm-evaluation
Turn any Java, Kotlin or Python project into an AI-ready context file in one command.
Package to set up autonomous agents to trade on TBD
- agents
- agents-md
- ai-agents
- autonomous-agents
Publish Claude Code usage telemetry to MQTT for Home Assistant (Clawdmeter-compatible mood/burn-rate sensors)
Catch silent failures in agent workflows by verifying real system state