Open-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.
- ai-red-team
- generative-ai
- red-team-tools
- responsible-ai
Repository Index
77,353 visible repositories in the index
73–96 of 180 · Most stars
Our library for RL environments + evals
The repository host gives no description.
OpenRAG is a comprehensive, single package Retrieval-Augmented Generation platform built on Langflow, Docling, and Opensearch.
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
- agi
- evaluation
- large-language-models
- multimodal
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
- gpt-4v
- large-language-models
- llava
- multi-modal
TranslatedChinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
- nlu
- benchmark
- chinese
- corpus
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
- transformers
- text-classification
- named-entity-recognition
- question-answering
AdalFlow: The library to build & auto-optimize LLM applications.
A series of large language models developed by Baichuan Intelligent Technology
Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.
LeanCTX is the Context Gateway for AI Systems. Select task-relevant context, apply supported controls, connect local knowledge and inspect recorded evidence. Open-source Engine: CLI, MCP, hooks and supported proxy paths.
A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
TranslatedOpen-source AI API relay benchmark, rankings & switcher for Claude Code / Codex: measured availability, latency and price
Open-source multimodal retrieval engine (Morphik Core)
- artificial-intelligence
- cache-augmented-generation
- colpali
- database
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
Evaluation and Tracking for LLM Experiments and AI Agents
- machine-learning
- neural-networks
- explainable-ml
- llmops
⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
[NeurIPS 2026] DataFlex: A Unified Benchmark and Evaluation Platform for Data-Centric Training of Large Language Models
- data-mixture
- data-science
- data-selection
- data-reweighting
[KDD'2026] "VideoRAG: Chat with Your Videos"
- large-language-models
- llms
- long-video-understanding
- multi-modal-llms
Open-source inference server and production cluster for all the models your agent needs.
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
- benchmark
- clustering
- information-retrieval
- sentence-transformers
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
- machine-learning
- convolutional-networks
- embedding-vectors
- embeddings