Open GenAI Stack
Repository Index
142,273 visible repositories in the index
169–192 of 1,944 · Most stars
Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
A collection of libraries to optimise AI model performances
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- cuda-kernels
- deepspeed
- fastertransformer
- llm-inference
AgentPilot: Make Your Agents Move Better and Faster
SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.
Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
- ingestion-api
- ocr
- omniparser
- parse-server
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
- artificial-intelligence
- attention-mechanisms
- deep-learning
- reinforcement-learning
TranslatedAI video note generation tool: let AI take notes for your videos
The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.
- ernie
- erniekit
- llm
- vlm
Run LLMs with MLX
- llms
- mlx
TranslatedSelf-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows. Yuxi = Cloud Agents + Knowledge RAG, Self-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows.
Infrastructure for continually self‑improving agents
GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
Adding guardrails to large language models.
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
- evaluation
- benchmark
- large-language-model
- llm
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
Chinese version of GPT2 training code, using BERT tokenizer.
- transformer
- gpt-2
- chinese
- nlp
This repo powers my experiment where ChatGPT manages a real-money micro-cap stock portfolio.
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
- llmops
- observability
- open-telemetry
- metrics
NeMo Guardrails is an open-source library for applying programmable safety and security controls to LLM and agentic applications.
- agents
- guardrails
- python
- safety
Home of StarCoder: fine-tuning & inference!
Tools for merging pretrained large language models.