SGLang is a high-performance serving framework for large language models and multimodal models.
Repository Index
47,133 repositories indexed
1–6 of 6 · Most stars
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
💼 An enterprise-grade Next.js boilerplate for high-performance, maintainable apps. Packed with features like Tailwind CSS, TypeScript, ESLint, Prettier, testing tools, and more to accelerate your development.
🦎 A lightweight, streaming-native, multi-protocol gateway for AI, APIs, and real-time data. Route LLM requests across providers, govern MCP tools, and connect Kafka, MQTT, and HTTP through one high-performance engine with shared security and observability.
Fast lossless JSON parse event streaming, in JavaScript.