Evaluation and Tracking for LLM Experiments and AI Agents
- machine-learning
- neural-networks
- explainable-ml
- llmops
102,118 visible repositories in the index
361–384 of 1,307 · Most stars
Evaluation and Tracking for LLM Experiments and AI Agents
Shortcuts for Siri using ChatGPT API, supports continuous conversations, configure the API key & save chat records. 由 ChatGPT API 模型驱动的智能 Siri,支持连续对话,配置API key,配置系统prompt,保存聊天记录。
[NeurIPS 2026] DataFlex: A Unified Benchmark and Evaluation Platform for Data-Centric Training of Large Language Models
Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
🚅 Interactive prompts made simple. Build a prompt like stacking blocks.
Convert Google Gemini web into OpenAI-compatible API. Zero auth, cross-platform, single file.
A full featured Live Chat, Support & Marketing platform, alternative to Intercom, Drift, Crisp.
An open-source research agent system for your Zotero library.
All-in-one AI desktop app: one-click install for Claude Code, Codex CLI, DeepSeek and more, manage AI accounts and quotas, smart model routing with auto-failover, voice input, and run local LLMs. Bonus: a Token Pet that grows as you use AI.
The cross-harness, self-improving memory layer for AI agents. Join our community: https://discord.com/invite/zdNChS2fBu
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
The official Go library for the OpenAI API
WhatsApp Web automation library for Node.js and TypeScript. Manage sessions, send and receive messages, handle media and build bots with Puppeteer. Part of the WPPConnect ecosystem.
A library for transfer learning by reusing parts of TensorFlow models.
ChatOllama is an open source agentic app for running AI agents across local and hosted models.
Open-source inference server and production cluster for all the models your agent needs.
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
Copy-ready prompts for the leading AI video and image models, each with its real output and source. Plus agent recipes for editing video.
Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
🦞 Just talk to your agent — it learns and EVOLVES 🧬.
Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models