KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.
Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
Desktop application of new Bing's AI-powered chat (Windows, macOS and Linux)
slime is an LLM training framework for RL Scaling.
Real-time Claude Code usage monitor with predictions and warnings
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
A Datacenter Scale Distributed Inference Serving Framework
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
TranslatedBELLE: Be Everyone's Large Language model Engine (open-source Chinese conversational large language model)
- bloom
- instruction-set
- llama
- open-models
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
- ingestion-api
- ocr
- omniparser
- parse-server
Minimal web UI for ChatGPT.
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
Fast, flexible LLM inference
Infrastructure for continually self‑improving agents
A series of large language models trained from scratch by developers @01-ai
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.
GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
Open Source LLM Gateway 🦚
Chinese version of GPT2 training code, using BERT tokenizer.