55,640 visible repositories in the index
1–24 of 39 · Most stars
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
Open-Source Web UI for Apache Kafka Management
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Apache Iceberg
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.
Apache NiFi
Policy and data administration, distribution, and real-time updates on top of Policy Agents (OPA, Cedar, ...)
The most widely used PHP client for RabbitMQ
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Kubernetes-native platform to run massively parallel data/streaming jobs
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
A cluster computing framework for processing large-scale geospatial data
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Barebone MQTT broker that can run on any stream server, the node way
EventMesh is a new generation serverless event middleware for building distributed event-driven applications.
MongooseIM is Erlang Solutions' robust, scalable and efficient XMPP server, aimed at large installations. Specifically designed for enterprise purposes, it is fault-tolerant and can utilise the resources of multiple clustered machines.
Lightweight data stream processing engine for IoT edge
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
Clean APIs for data cleaning. Python implementation of R package Janitor