Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
- data-drift
- jupyter-notebook
- pandas-dataframe
- machine-learning
Repository Index
67,262 visible repositories in the index
49–72 of 155 · Most stars
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
- ingestion-api
- ocr
- omniparser
- parse-server
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
- evaluation
- benchmark
- large-language-model
- llm
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
- llmops
- observability
- open-telemetry
- metrics
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
Software in C and data files for the popular GloVe model for distributed word representations, a.k.a. word vectors or embeddings
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
- gateway
- generative-ai
- llm-inference
- llms
Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.
Postgres with GPUs for ML/AI apps.
- ml
- machine-learning
- ai
- ann
🚀🧠💬 Supercharged Custom Instructions for ChatGPT (non-coding) and ChatGPT Advanced Data Analysis (coding).
Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google
- ai
- genkit
- vector-database
- embedders
Translated🌻 One click access to your own ChatGPT+Many AI web services
The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI and knowledge graphs
- ai
- ast
- claude-code
- code-analysis
Neo4j graph construction from unstructured data using LLMs
- data-import
- genai
- graph
- graph-rag
Official Agnes AI gateway and model catalog for OpenAI-compatible text, image, video, and agent workflows.
- agnes-ai
- ai-api
- multimodal-ai
- free-api
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
- ai
- chain-of-thought
- collaboration
- dataset-generation
Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM
- machinelearning
- huggingface-transformers
- computer-vision
- llm
Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.
TranslatedDeepAnalyze is the first agentic LLM for autonomous data science. 🎈Your AI data analyst, automatically analyzes large amounts of data and generates professional analysis reports with one click!
Aligning pretrained language models with instruction data generated by themselves.
- general-purpose-model
- language-model
- instruction-tuning
A bio-inspired cognitive memory engine — a new paradigm for Graph RAG.
- agent-memory
- agentic-ai
- ai-reasoning
- episodic-memory
SQL Translator is a tool for converting natural language queries into SQL code using artificial intelligence. This project is 100% free and open source.
- data-analysis
- data-engineering
- dataquery
- datascience
TranslatedChinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
- nlu
- benchmark
- chinese
- corpus