Repository Index

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

• evaluation
• llm
• performance
• rag

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

• llm-guardrails
• llm-security
• llm-jailbreaks
• llm-scanner

A lightweight Python SDK and CLI for evaluating recursive self-improvement (RSI) methods across agent benchmarks.

• ai-agents
• benchmarking
• llm-evaluation
• python

Benchmark harness and data: QEMU emulation vs native Buildx nodes for multi-arch container builds.

Fragscapy is a command-line tool to fuzz network protocols by automating the modification of outgoing network packets. It can run multiple successive tests to determine which options can be used to evade firewalls and IDS.

• fuzzing
• network
• ids
• firewall

⚡ JEval helps you to evaluate your JMeter test plan and provides recommendation before you start your performance testing. All contributions welcome 🙏.

• jmeter
• python
• performance
• performance-testing

Open-source simulation harness for testing AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.

• ai-agents
• ai-testing
• llm
• llm-evaluation