Evaluation toolbox for Sound Event Detection
Repository Index
77,353 visible repositories in the index
265–288 of 293 · Most stars
Committed to building the world’s most cutting-edge, CJK-first memory module for all mainstream agents. Any issues and PRs are welcome.
- agent-memory
- agent-skills
- mcp
- memory
DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.
- benchmark
- calibration
- decision-making
- evaluation
DSP algorithms for chord detection + key estimation
- chromagram
- chords
- autocorrelation
- polyphonic
TranslatedMultimodal retrieval in practice: intent recognition, prompt engineering, Qwen LoRA, EmbeddingGemma 2, and InfoNCE contrastive learning. Includes real demos, integration of your own data, training and evaluation, and a learning guide to RAG retrieval components.
- clip
- ecommerce
- image-retrieval
- image-search
A Macau food recommendation Agent built on Thompson Sampling + StackedPareto weight fusion, with a full evaluation pipeline (5-fold CV, bootstrap CIs, stress tests) on 5,000 simulated users and 100k interactions. Competition entry for the QwenPaw AI Developer Challenge.
Turn intent into work. Open-source Desktop/Web agent harness with long-horizon memory, live evaluation and recoverable batches.
- agentic-ai
- browser-automation
- computer-use-agents
- desktop-automation
The repository host gives no description.
Benchmark harness and data: QEMU emulation vs native Buildx nodes for multi-arch container builds.
Self-healing Docker CI: BuildKit failure taxonomy, Claude Code fixes, rebuild verification, capped retries.
Security-hardened MCP server for Docker with read-only defaults, restart deny-lists, and secret redaction
Auto-optimizing a neural net (and its architecture) on the CIFAR-100 dataset. Could be easily transferred to another dataset or another classification task.
- hyperopt
- hyperparameter-optimization
- hyperparameter-tuning
- hyperparameters-optimization
Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents
Auto Ontology is a Python framework for building semantic, graph-based reasoning layers over data. It enables deterministic query generation, better context retrieval, and more explainable AI for LLM and agent workflows.
Nosis is a lightweight personal agent runtime: per-session execution boundaries with OS-level sandboxing, computer use, a full built-in toolset, Skill / Plugin / MCP extensions, one runtime shared by GUI and TUI, and file-persisted sessions, plans, and memory.
- agent-framework
- agent-runtime
- agent-skills
- ai-agent
Fragscapy is a command-line tool to fuzz network protocols by automating the modification of outgoing network packets. It can run multiple successive tests to determine which options can be used to evade firewalls and IDS.
Test harness for voice agents. Import from Retell, VAPI, Bland, LiveKit. Run autonomous simulations. Evaluate with LLM judges.
- bland
- dspy
- livekit
- llm
⚡ JEval helps you to evaluate your JMeter test plan and provides recommendation before you start your performance testing. All contributions welcome 🙏.
- jmeter
- python
- performance
- performance-testing
HistoClean is a tool for the preprocessing and augmentation of images used in deep learning models. This easy to use application brings together the most popular image processing packages from across the python universe, meaning no more looking at documentation! HistoClean provides real time feedback to augmentations and preprocessing options. This allows users to evaluate their steps before implementation.
- image-processing
- images
- image-analysis
- deep-learning
A structured, multi-agent Claude Code learning environment for mastering Retrieval-Augmented Generation (RAG)
Sublime Text plugin to run elm-format on save
- elm
- sublime-text
- elm-format
- editor-plugin
The repository host gives no description.
Evaluation of packer type estimation/detection tools
Code and data for the paper "Evaluating German Transformer Language Models with Syntactic Agreement Tests" (Zaczynska et al., 2020)
- bert
- transformers
- syntactic-agreement
- german