SGLang is a high-performance serving framework for large language models and multimodal models.
Repository Index
105,102 visible repositories in the index
1–24 of 32 · Most stars
An open-source RAG-based tool for chatting with your documents.
TranslatedThe official repo of Qwen chat & pretrained large language model proposed by Alibaba Cloud.
- chinese
- large-language-models
- natural-language-processing
- flash-attention
A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- attention-mechanism
- deep-learning
- gpt
- gpt-2
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
- artificial-intelligence
- attention-mechanisms
- deep-learning
- reinforcement-learning
Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
- chatbot
- gpt
- large-language-model
- long-context
TranslatedChinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Open-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.
- ai-red-team
- generative-ai
- red-team-tools
- responsible-ai
🚅 Interactive prompts made simple. Build a prompt like stacking blocks.
- cli
- command-line-tool
- prompts
- customization
The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention
- large-language-models
- llm
- minimax-text-01
- minimax-vl-01
MiniMax-M1, the world's first open-weight, large-scale hybrid-attention reasoning model.
- large-language-models
- llm
- reasoning-models
- minimax-m1
Convert HTML to Markdown-formatted text.
Convert HTML to Markdown
Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks
Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.
- tika-server
- python
- tika-python
- tika-server-jar
Fine-tune Gemma 4 and 3n with audio, images and text on Apple Silicon, using PyTorch and Metal Performance Shaders.
tl/dw (Too Long, Didn't Watch): Your Personal Research Multi-Tool - a naive attempt at 'A Young Lady's Illustrated Primer' (Open Source NotebookLM)
- ai-assistant
- ai-ml
- llm
- multi-tool
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
A Solution Accelerator for the RAG pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences. This includes most common requirements and best practices.
- ai-search
- azd-templates
- azure
- azure-openai
Open-source voice-AI SDK. The Vapi/Retell alternative for builders who want to own the stack. Give your AI agent a phone number in 4 lines — Python and TypeScript, MIT licensed, Twilio, Telnyx, and Plivo.
- open-source
- openai
- python
- sdk
A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
- benchmark
- large-language-models
- prompt-injection
- security
From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% attention fidelity.