A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
54,141 visible repositories in the index
1–13 of 13 · Most stars
Get your documents ready for gen AI
SGLang is a high-performance serving framework for large language models and multimodal models.
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
- semantic-search
- emacs
- obsidian-md
- chat
Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work.
- agent-skills
- ai-agents
- context-engineering
- document-processing
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
Home of StarCoder: fine-tuning & inference!
TranslatedOpen-source manuscript of 《深入理解 AI Infra：量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
- accelerator
- ai-infra
- ai-infrastructure
- book
Local inference for diffusion language models (LLaDA, Dream), written in Mojo
- cpu
- diffusion-models
- gguf
- inference
Runtime defense against memory poisoning in AI agents (OWASP ASI06). Drop-in for LangChain, OpenAI Agents, AutoGen, CrewAI and mem0.
project on fine-tuning qwen to generate text w/o letter 'e'
DeepSeek Harness Desktop 插件，让 AI Agent 用自然语言构建、检查和维护可编辑的 SideFX Houdini 工程，支持程序化建模、HDA、场景诊断与渲染。 | A DeepSeek Harness Desktop plugin that lets AI agents build, inspect, and maintain editable SideFX Houdini projects with natural language, including procedural modeling, HDAs, scene diagnostics, and rendering.
- dsh-plugin
- houdini
- ai-agent
Turn any Java, Kotlin or Python project into an AI-ready context file in one command.