A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
Repository Index
110,088 visible repositories in the index
1–7 of 7 · Most stars
XcodeBenchmark measures the compilation time of a large codebase on iMac, MacBook, and Mac Pro
Hercules is the world’s first open-source testing agent, enabling UI, API, Security, Accessibility, and Visual validations – all without code or maintenance. Automate testing effortlessly and let Hercules handle the heavy lifting! ⚡
- ai
- autogen
- automation
- browser
AIRecon is an autonomous cybersecurity agent that combines a self-hosted Large Language Model (Ollama) with a Kali Linux Docker sandbox and a Textual TUI. It is designed to automate security assessments, penetration testing, and bug bounty reconnaissance — without any API keys or cloud dependency.
- ai-agents
- bugbounty
- ollama
- penetration-testing
Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
- code-execution
- code-generation
- code-llms
- code-repair
Towards Large-Scale Emulation of IoT Firmware for Dynamic Analysis
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
- classification
- fine-tuning
- finetuning
- large-language-models