The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
- system-design
- backend
- scalability
- interview
Repository Index
47,133 repositories indexed
1–24 of 36 · Most stars
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
- anns
- nearest-neighbor-search
- faiss
- vector-search
A scalable, distributed, collaborative, document-graph database, for the realtime web
- database
- distributed
- distributed-database
- document-database
Memory and context engine + app that is extremely fast, scalable, and can be run fully locally. The Memory API for the AI era.
- cloudflare-pages
- cloudflare-workers
- drizzle-orm
- tailwindcss
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
- orchestration
- data-orchestration
- high-availability
- infrastructure-as-code
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
- gbdt
- gbrt
- gbm
- distributed-systems
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
- semantic-search
- information-retrieval
- ai
- python
High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios
Scalable PaaS (automated Docker+nginx) - aka Heroku on Steroids
OceanBase is the unified distributed database for the AI era — open-source, multi-model, one engine for your most demanding workloads.
- oceanbase
- paxos
- htap
- cloud-native
Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.
- uber
- cadence
- workflows
- orchestration-engine
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Highly scalable realtime pub/sub and RPC framework
Fast, simple, scalable, Docker-ready HTTP microservice for high-level image processing
- image
- image-processing
- resize-images
- libvips
ZoneMinder is a free, open source Closed-circuit television software application developed for Linux which supports IP, USB and Analog cameras.
- zoneminder
- cctv
- video
- vms
An open-source authorization as a service inspired by Google Zanzibar, designed to build and manage fine-grained and scalable authorization systems for any application. — Permify is now part of FusionAuth 🎉
- access-control
- authorization
- rbac
- rebac
A horizontally scalable, highly available, multi-tenant, long term Prometheus.
A distributed MQTT message broker based on Erlang/OTP. Built for high quality & Industrial use cases. The VerneMQ mission is active & the project maintained. Thank you for your support!
- mqtt
- m2m
- scalable
- broker
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
- distributed-computing
- map-reduce
- golang
- distributed-systems
Misago is fully featured modern forum application that is fast, scalable and responsive.
- forums
- forum
- django
- python
Build AI (or any) apps with scalable microservices & microfrontends.
- paas
- microservices
- ai
- on-premise
A modular, scalable and ultra-fast open-source all-in-one eCommerce platform built on ASP.NET Core 10
NFF-Go -Network Function Framework for GO (former YANFF)
- dpdk
- golang
- networking
- vnf