Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
- database
- distributed-database
- distributed-sql-database
- sql
Apache Doris is a real-time analytics and hybrid search database for AI agents.
Full Modular Monolith application with Domain-Driven Design approach.
- ddd
- ddd-architecture
- cqrs
- architecture
A distributed, fast open-source graph database featuring horizontal scalability and high availability
A curated list of Domain-Driven Design (DDD), Command Query Responsibility Segregation (CQRS), Event Sourcing, and Event Storming resources
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
Cloud-native OSS search engine for observability
Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably, socket.io, Phoenix.PubSub, SignalR. Set up once and forever.
Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
Python SQL Parser and Transpiler
Open Source Feature Flags, Experimentation, and Product Analytics
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.
The Open Source Feature Store for AI/ML
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
the portable Python dataframe library
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
a little task queue for python
The polyglot queue: Fast and reliable background jobs in Go, Java, JS, Ruby, and Rust on Postgres/SQLite.