A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
85,578 visible repositories in the index
1–24 of 53 · Most stars
Get your documents ready for gen AI
SGLang is a high-performance serving framework for large language models and multimodal models.
PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.
Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.
- a2a
- a2a-mcp
- a2a-protocol
- a2a-server
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
Free, local tool to track AI coding token usage and cost across 37 tools and agents (Claude Code, Cursor, Codex, Gemini and more), by model, project, and task. npx codeburn
An Application Framework for AI Engineering
- artificial-intelligence
- java
- spring-ai
Providing a free OpenAI GPT-4 API ! This is a replication project for the typescript version of xtekky/gpt4free
Home of StarCoder: fine-tuning & inference!
An open, programmable decision layer for models and compute.
- mixture-of-models
- semantic-router
- vllm
- ai-gateway
The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.
- llm
- llm-reasoning
- machine-learning-systems
- mlsys
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
SQL Translator is a tool for converting natural language queries into SQL code using artificial intelligence. This project is 100% free and open source.
- data-analysis
- data-engineering
- dataquery
- datascience
AI IDE for hardware development, support Arduino, MicroPython, ESP32, STM32, RP2040, Nrf5x...
OpenDeepWiki is the open-source version of the DeepWiki project, aiming to provide a powerful knowledge management and collaboration platform. The project is mainly developed using C# and TypeScript, supporting modular design, and is easy to expand and customize.
- chatgpt
- deepwiki
- docs
- fine-tuning
Templates and workflow for generating PRDs, Tech Designs, and MVP and more using LLMs for AI IDEs
- ai-agents
- ai-workflow
- beginner-friendly
- mvp-development
Let ChatGPT teach your own chatbot in hours with a single GPU!
Community maintained hardware plugin for vLLM on Huawei Ascend
⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.
The goal of this project is to enable users to create cool web demos using the newly released OpenAI GPT-3 API with just a few lines of Python.
vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
Research project. A Memory solution for users, teams, and applications.