Repository Index

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

• llama
• llm
• llms
• go

A high-throughput and memory-efficient inference and serving engine for LLMs

• gpt
• llm
• pytorch
• model-serving

SGLang is a high-performance serving framework for large language models and multimodal models.

• cuda
• inference
• llama
• llm

gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

• ai
• faiss
• langchain
• llama-index

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!

• llms
• lora
• reinforcement-learning
• agent

An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.

• ai-agent
• ai-assistant
• chatgpt-alternative
• claude-alternative

🧱 Experimental library for building inference engines

• inference
• llm
• cuda
• gpt-oss