Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
Open-Source Web UI for Apache Kafka Management
- kafka-ui
- kafka-brokers
- kafka
- kafka-streams
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
- kedro
- hacktoberfest
- mlops
- python
Apache Iceberg
- iceberg
- apache
- hacktoberfest
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Apache KIE (Knowledge Is Everything) is the home of Drools, OptaPlanner, jBPM, and Kogito.
- rule-engine
- java
- dmn
- hacktoberfest
Apache NiFi
- nifi
- java
- hacktoberfest
- apache
Policy and data administration, distribution, and real-time updates on top of Policy Agents (OPA, Cedar, ...)
Reactive Extensions for the Go language.
- reactivex
- golang
- observable
- go
The most widely used PHP client for RabbitMQ
The open source repository for Electricity Maps data parsers that powers the world's most comprehensive electricity data platform
Utils for streaming large files (S3, HDFS, gzip, bz2...)
The official repository for ROOT: analyzing, storing and visualizing big data, scientifically
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
SaaS Boilerplate - Open Source and free SaaS stack that lets you build SaaS products faster in React, Django and AWS. Focus on essential business logic instead of coding repeatable features!
Kubernetes-native platform to run massively parallel data/streaming jobs
Open MPI main development repository
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
Open-source software for volunteer computing and grid computing.
A cluster computing framework for processing large-scale geospatial data
- cluster-computing
- spatial-sql
- geospatial
- spatial-analysis