82,588 visible repositories in the index
25–48 of 54 · Most stars
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.
This project aims to compare and evaluate the telemetry of various EDR products.
SkillsBench evaluates how well skills work and how effective agents are at using them.
[CVPR2024 Highlight] VBench - We Evaluate Video Generation
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Graphical Python debugger which lets you easily view the values of all evaluated expressions
This is an IoT device communication protocol implementation client, which will include common industrial communication protocols such as mainstream PLC communication reading, ModBus protocol, and Bacnet protocol. This component is open source and free for life, using the most relaxed MIT open source agreement, you can modify and commercial use at will (commercial use please evaluate and test). 这是一个物联网设备通讯协议实现客户端，将会包括主流PLC通信读取、ModBus协议、Bacnet协议等常用工业通讯协议。本组件终身开源免费，采用最宽松的MIT开源协议，您可以随意修改和商业使用（商业使用请做好评估和测试）。
A benchmark built to evaluate and improve agent capabilities for supporting legal work.
This CSS file intends to warn developers about possible risks and mistakes that exist in HTML code. It can also be used to roughly evaluate a site's quality by simply including it as an external stylesheet.
The living ecosystem where AI agents complete tasks through workflow loops, improve through iterative execution, are evaluated by mentor agents or humans in the loop, and turn completed work into reusable work experience and data to improve future agents.
A utility to safely generate malicious network traffic patterns and evaluate controls.
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
Evaluate OMR sheets fast and accurately using a scanner 🖨 or your phone 🤳.
math and logic formula parser and evaluator
Expression evaluation in golang
Framework to evaluate peformance of ROS 2
Neovim plugin that evaluates code blocks inside documents
Overlay is a browser extension helping developers evaluate open source packages before picking them
Evaluate JavaScript from Crystal!
Pre-evaluate code at build-time with babel-macros
Evaluate Nodejs Code Snippets From Menubar! :computer:
Parses and evaluates mathematical expressions in Elixir. Inspired by math.js