A library for building fast, reliable and evolvable network services.
Repository Index
132,241 visible repositories in the index
1–6 of 6 · Most stars
PostgreSQL connection pooler, load balancer and database sharder.
- load-balancer
- pooler
- postgresql
- rust
PostgreSQL pooler with sharding, load balancing and failover support.
- pooler
- postgresql
- pooling
- rust
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
The fast and secure Load Balancer / API Gateway / Reverse Proxy with built-in service discovery, GeoIP, WAF, bot protection and much more - https://pingoo.io
- anti-bot
- api
- api-gateway
- captcha
Streaming-first load balancer for AI inference gateways