Code for the paper "Evaluating Large Language Models Trained on Code"
Repository Index
77,353 visible repositories in the index
97–120 of 180 · Most stars
SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese
- chatgpt
- chinese
- evaluation
- foundation-models
RAG Web UI is an intelligent dialogue system based on RAG (Retrieval-Augmented Generation) technology.
Comet: agent skill harness for turning ideas into evaluated workflows
Fast, Accurate, Lightweight Python library to make State of the Art Embedding
- embeddings
- openai
- rag
- retrieval
Inspect: A framework for large language model evaluations
QuantMind is an open source agent-native knowledge extraction and retrieval framework for quantitative finance.
- quantitative-finance
- quantitative-research
- data
- knowledge
AI Search & RAG Without Moving Your Data. Get instant answers from your company's knowledge across 100+ apps while keeping data secure. Deploy in minutes, not months.
- search
- search-engine
- federated-query
- federated-search
An open-source visual programming environment for battle-testing prompts to LLMs.
- ai
- evaluation
- large-language-models
- llmops
Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
mean Average Precision - This code evaluates the performance of your neural net for object recognition.
- machine-learning
- pascal-voc
- average-precision
- ground-truth
Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.
A new SOTA for RAG — an original retrieval architecture and an open-source knowledge base for humans and agents.
⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
A 13B large language model developed by Baichuan Intelligent Technology
- artificial-intelligence
- chatgpt
- chinese
- gpt-4
The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.
- colpali
- information-retrieval
- retrieval-augmented-generation
- vision-language-model
Easily compute clip embeddings and build a clip retrieval system with them
- semantic-search
- deep-learning
- multimodal
- ai
All-in-one platform for search, recommendations, RAG, and analytics offered via API
- actix-web
- diesel
- postgresql
- qdrant
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
- evaluation
- evaluation-framework
- evaluation-metrics
- huggingface
A benchmark for evaluating LLMs on Chinese traditional fortune telling — Bazi (八字) and Ziwei Doushu (紫微斗数).
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
- deep-learning
- flax
- jax
- language-model
HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
- evaluation
- machine-learning
AssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for Industry 4.0 asset operations and maintenance, with 460+ scenarios, 5 specialist agents (IoT, FMSR, TSFM, Work Order,...), and multi-agent orchestration blueprints (MetaAgent, AgentHive) over MCP.
- llm-agents
- model-context-protocol
- time-series-forecasting
- condition-based-maintenance