Evaluation and Tracking for LLM Experiments and AI Agents
- machine-learning
- neural-networks
- explainable-ml
- llmops
109,091 visible repositories in the index
217–240 of 889 · Most stars
Evaluation and Tracking for LLM Experiments and AI Agents
Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).
Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
🚅 Interactive prompts made simple. Build a prompt like stacking blocks.
A full featured Live Chat, Support & Marketing platform, alternative to Intercom, Drift, Crisp.
All-in-one AI desktop app: one-click install for Claude Code, Codex CLI, DeepSeek and more, manage AI accounts and quotas, smart model routing with auto-failover, voice input, and run local LLMs. Bonus: a Token Pet that grows as you use AI.
The cross-harness, self-improving memory layer for AI agents. Join our community: https://discord.com/invite/zdNChS2fBu
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
WhatsApp Web automation library for Node.js and TypeScript. Manage sessions, send and receive messages, handle media and build bots with Puppeteer. Part of the WPPConnect ecosystem.
An open source implementation of OpenAI's ChatGPT Code interpreter
Open-source inference server and production cluster for all the models your agent needs.
[KDD'2026] "VideoRAG: Chat with Your Videos"
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
Open-source AI humanizer: rewrite AI-generated text into natural, human-sounding prose. LLM rewriting + multi-engine translation, with step-by-step traces. Python CLI, n8n & Docker.
OML 1.0 via Fingerprinting: Open, Monetizable, and Loyal AI
ChatGPT interface with better UI
Digital Avatar Conversational System - Linly-Talker. 😄✨ Linly-Talker is an intelligent AI system that combines large language models (LLMs) with visual models to create a novel human-AI interaction method. 🤝🤖 It integrates various technologies like Whisper, Linly, Microsoft Speech Services, and SadTalker talking head generation system. 🌟🔬
🦞 Just talk to your agent — it learns and EVOLVES 🧬.
Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
OP Vault ChatGPT: Give ChatGPT long-term memory using the OP Stack (OpenAI + Pinecone Vector Database). Upload your own custom knowledge base files (PDF, txt, epub, etc) using a simple React frontend.