Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
- workflow-schedule
- azkaban
- airflow
- task-scheduler
Repository Index
47,133 repositories indexed
1–24 of 31 · Most stars
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
Migrate to PostgreSQL in a single command!
- postgresql
- migration
- mysql
- mssql
Privacy and Security focused Segment-alternative, in Golang and React
- privacy
- warehouse-management
- data-warehouse
- customer-data
A light-weight, flexible, and expressive statistical data testing library
- pandas
- validation
- schema
- dataframes
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
- datalake
- lakehouse
- metadata
- federated-query
A modern high-performance open source message queuing system
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
- dataops
- dataops-platform
- elt
- open-source
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
- flogo
- iot
- integration
- golang
Messaging APIs for multi-platform
- messaging
- messenger
- line
- api-client
Embulk: Pluggable Bulk Data Loader.
- embulk
- bulk-loader
Ncurses based XMPP client
- xmpp-client
- c
- xmpp
- chat
Livy is an open source REST interface for interacting with Apache Spark from anywhere
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
A modern .NET framework for communication over RabbitMq
- rabbitmq
- dotnetcore
- message-bus
- async
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
Amazon Redshift Database Loader implemented in AWS Lambda
🌱 The ultimate solution for populating your MongoDB database.
Data validation toolkit for assessing and monitoring data quality.
- data-validation
- tabular-data
- data-testing
- data-quality
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
STOMP client for Embarcadero Delphi and FreePascal.
- stomp
- delphi
- activemq
- pascal
Bash script to export android content providers data to csv
Database synchronizer for Magento 2 (and Wordpress), based on Magerun2. Keeping development, staging and production in sync easily.