Supercharge Your LLM Application Evaluations 🚀
- llm
- llmops
- evaluation
Repository Index
47,133 repositories indexed
25–48 of 110 · Most stars
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
- agentneo
- agents
- ai-performance-optimization
- llm-testing
Unified framework for building enterprise RAG pipelines with small, specialized models
- parsing
- retrieval-augmented-generation
- agents
- generative-ai-tools
A framework for few-shot evaluation of language models.
- evaluation-framework
- language-model
- transformer
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
- python
- search
- nlp
- semantic-search
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
Agent S: the state-of-the-art open source computer use agents
- agent-computer-interface
- ai-agents
- computer-automation
- gui-agents
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
- bert
- sentence-encoding
- deep-learning
- clip-model
Retrieval and Retrieval-augmented LLMs
- embeddings
- information-retrieval
- llm
- sentence-embeddings
AI Observability & Evaluation
- llmops
- ai-monitoring
- ai-observability
- llm-eval
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
Pocket Flow: 100-line LLM framework. Let Agents build Agents!
- agents
- flow-based-programming
- flow-engineering
- llm-agent
Translated[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. An open-source multimodal dialogue model with performance close to GPT-4o
- image-classification
- image-text-retrieval
- llm
- semantic-segmentation
the LLM vulnerability scanner
- ai
- llm-evaluation
- llm-security
- security-scanners
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
- academia
- arxiv
- brave
- deep-research
An open source reinforcement learning framework for training, evaluating, and deploying robust trading agents.
High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
Python package for the evaluation of odometry and SLAM
- slam
- odometry
- evaluation
- metrics
Long-term memory runtime for AI agents — plain Markdown as the source of truth, local ranked retrieval, and an independent sleep-time Manage layer. Claude Code and Codex share one store. No API key.
Visual localization made easy with hloc
- deep-learning
- visual-localization
- feature-matching
- image-retrieval
Accelerated deep learning R&D
Deep neural network to extract intelligent information from invoice documents.
- invoice
- invoice-management
- invoices
- invoice-insight
Fast numerical array expression evaluator for Python, NumPy, Pandas, PyTables and more