Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
Repository Index
103,113 visible repositories in the index
1–24 of 32 · Most stars
This repo powers my experiment where ChatGPT manages a real-money micro-cap stock portfolio.
Democratizing Reinforcement Learning for LLMs
- agent-framework
- agentic-workflow
- distributed-training
- llm-training
🧩 FrontierAgent, our agent framework, open-sourced alongside it — native command-line TUI, ReAct and Agent Team modes, one command on macOS and Linux, no preinstall, no hard Docker dependency.
- agent-orchestration
- ai-agents
- harness
- agentic-ai
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents
- generative-ai
- hallucinations
- llm
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
- agent
- artificial-intelligence
- benchmark
- multimodal
mean Average Precision - This code evaluates the performance of your neural net for object recognition.
- machine-learning
- pascal-voc
- average-precision
- ground-truth
AssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for Industry 4.0 asset operations and maintenance, with 460+ scenarios, 5 specialist agents (IoT, FMSR, TSFM, Work Order,...), and multi-agent orchestration blueprints (MetaAgent, AgentHive) over MCP.
- llm-agents
- model-context-protocol
- time-series-forecasting
- condition-based-maintenance
Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
- mcp
- modelcontextprotocol
- mcp-clients
- mcp-tools
Local typed decisions, contrastive data curation, and model evaluation.
[CVPR 2025] A Comprehensive Benchmark for Document Parsing and Evaluation
ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.
A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.
- agent
- deer-flow
- develop
- electrobun
An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)
- document
- document-analysis
- extraction
- llms
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
BERT score for text generation
AutoChain: Build lightweight, extensible, and testable LLM Agents
A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.
- artificial-intelligence
- documentai
- multimodal
- multimodal-deep-learning
The repository host gives no description.
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
- natural-language-generation
- natural-language-processing
- nlg
- nlp
Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
- ai-agents
- ci-cd
- evals
- llm-evaluation
Open memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform
The repository host gives no description.