Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.
Repository Index
132,241 visible repositories in the index
49–72 of 184 · Most stars
Fast ASGI web framework for Python
- asyncio
- server
- http
- asgi
Python library for implementing GraphQL servers using schema-first approach. Created with :heart: by Mirumee
- python
- graphql
- graphql-server
- api
Steam 挂刀行情站 —— 24小时更新的 BUFF & IGXE & C5 & UUYP & ECO 挂刀比例数据 | Track cheap Steam Community Market items on buff.163.com, igxe.cn, c5game.com, youpin898.com and ecosteam.cn.
- steam
- steam-trading
- csgo
- dota2
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
Translate GPU shaders and compute kernels between GLSL, HLSL, Metal, SPIR-V, Slang, CUDA and HIP, and to WGSL, through the CrossGL IR
Scots Army Knife for electronics
AWS Lambda support for ASGI applications
- asgi
- aws
- lambda
- serverless
Evolutionary algorithm toolbox and framework with high performance for Python
- geatpy
- ga
- de
- es
MessagePack serializer implementation for Python msgpack.org[Python]
- python
- msgpack
A rate limiter for Starlette and FastAPI
- starlette
- fastapi
- rate-limiter
- asgi
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
- gpu-sharing
- kvcache
- llm
- sglang
A Deep Learning Approach for Password Guessing (https://arxiv.org/abs/1709.00440)
- password-cracking
- machine-learning
- deep-learning
- gan
Learn autonomous driving by building it: Python simulations and an open textbook where the system grows one stage at a time. Swap and compare localization, planning and control algorithms in the same system.
- algorithm
- autonomous-driving
- autonomous-navigation
- autonomous-vehicles
A fast, user friendly ORM and query builder which supports asyncio.
- piccolo
- asyncio
- python
- python3
TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Models
- 3d-generation
- 3d-reconstruction
- image-to-3d
- 3d-genai
HomeAssistant 国家电网电费查询
⚠️ Experimentelle Skill-Sammlung für deutsches Recht (Arbeits-, Gesellschafts-, Insolvenz-, Datenschutz-, Prozessrecht u.a.) – inzwischen verbessert und im Alltag getestet, aber weiterhin Experiment. Bitte selber ausprobieren, Issues/PRs willkommen! Keine Rechtsberatung. Mandatsgeheimnis (§§ 203/204 StGB, § 43e BRAO), DSGVO, US-Transfer, KI-VO & Co
- anthropic
- bgh
- claude-skills
- dsgvo
A curated list of awesome ASGI servers, frameworks, apps, libraries, and other resources
- python
- asgi
- awesome-list
- awesome
High Performance Serving Runtime For Interactive Super Intelligence System
A high-speed covert tunnel that disguises TCP traffic as SMTP email communication to bypass Deep Packet Inspection (DPI) firewalls.
- censorship-circumvention
- censorship-resistance
- covert-tunnel
- deep-packet-inspection
The fastest Python web framework, built on Django. Rust (Actix Web) HTTP server + async typed handlers + msgspec, with the full Django ORM, Admin, middleware and auth. 300k+ req/s, no gunicorn/uvicorn.
Yet Another Python Profiler, but this time multithreading, asyncio and gevent aware.
- profilers
- multi-threaded-applications
- coroutine
- asynchronous