Open-source platform for creating safe, isolated production sandboxes for API, integration, and E2E testing.
Repository Index
47,133 repositories indexed
1–24 of 26 · Most stars
ARTEMIS turns natural-language instructions into reliable Android automation. It automates end-to-end workflows, captures logs, and integrates seamlessly with AI coding assistants such as Antigravity, Codex, and Claude Code. It also achieves 99%+ success rate on AndroidWorld Benchmark.
See interfaces like a human. E2E testing in natural language.
- testing
- browser-use
- computer-use
- gpt-operator
🕷 Super-agent driven library for testing node.js HTTP servers using a fluent API. Maintained for @forwardemail, @ladjs, @spamscanner, @breejs, @cabinjs, and @lassjs.
- supertest
- superagent
- assertions
- node
The elegant testing framework for PHP developers and AI agents.
- php
- testing
- pest
- framework
QA Wolf from anywhere — your terminal, your CI, your AI agent.
Global edition of ARTEX — an LLM multi-agent autonomous penetration-testing framework. English default, switchable to Korean/Chinese/Spanish/Japanese. For authorized, defensive and detection use only. (upstream: Autumn-27/ARTEX, AGPL-3.0)
A contract-driven gRPC regression harness for AI coding agents, with human-approved baselines. Snapshot the valid call chains of an API so an agent can look one up instead of tracing for it. gRPC today, OpenAPI next
Hercules is the world’s first open-source testing agent, enabling UI, API, Security, Accessibility, and Visual validations – all without code or maintenance. Automate testing effortlessly and let Hercules handle the heavy lifting! ⚡
- ai
- autogen
- automation
- browser
Open-source self-improving QA agent for software teams. A test harness with memory. Write tests in natural language for web and mobile. agent-qa learns from every run, adapts to UI changes, and catches regressions before you ship.
- playwright
- end-to-end-testing
- ai-testing
- ai-agents
Framework allows to perform load testing with Apache Jmeter, view application/server metrics in real-time with Grafana, analyze errors cause with detailed traces for failed requests, compare different test runs in scripted dashboard and perform frontend performance testing with sitespeed.io+webpagetest
Shift-left API Integration | Auto-fix integration drift before integration. Specmatic turns API specifications into executable contracts, continuously verifying that every change made by AI coding agents and engineers stays true to the desired behaviour. Ship AI-ready APIs 10x faster, from intent to implementation, with Spec-Driven API Development.
- contract-testing
- microservices
- contract-driven-development
- cdd
A lightweight Python SDK and CLI for evaluating recursive self-improvement (RSI) methods across agent benchmarks.
Cross-browser web performance testing agent
Hardware testing for the software world. Real or virtual, local or remote, human, automated or agentic.
- hardware
- hardware-in-the-loop
- hil
- testing-framework
A community-driven Cypress testing suite for Magento 2
Super-agent driven library for testing Deno HTTP servers.
- deno
- typescript
- superdeno
- supertest
The AI-native browser automation library. Snapshot + ref targeting — born from OpenClaw, built for agents, by agents.
LLM and agent evaluation for Java & Kotlin. Runs in JUnit and CI. Spring AI, LangChain4j, Koog, Embabel, and any LLM client.
- agent-evaluation
- evaluation-framework
- evaluation-metrics
- java
Test harness for voice agents. Import from Retell, VAPI, Bland, LiveKit. Run autonomous simulations. Evaluate with LLM judges.
- bland
- dspy
- livekit
- llm
Laravel-style database seeder for Magento 2 / Mage-OS. Generate realistic products (all types), categories, customers, orders (all states), CMS pages, and reviews via bin/magento db:seed.
- dev-tools
- faker
- fixtures
- mage-os
JVM runtime execution analysis - finds hot code paths by frequency, not CPU time
- asm
- bytecode
- code-coverage
- java
Open-source simulation harness for testing AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.
- ai-agents
- ai-testing
- llm
- llm-evaluation
Framework-agnostic evaluation harness for Go — test your MCP servers and AI agents with scored, CI-ready checks.