SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
142,187 visible repositories in the index
1–20 of 20 · Most stars
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Flink CDC is a streaming data integration tool
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
Apache NiFi
Spring Batch is a framework for writing batch applications using Java and Spring
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Hop Orchestration Platform
Apache InLong - a one-stop, full-scenario integration framework for massive data
Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.
Graph+Semantics: Import/Export RDF from Neo4j. SHACL Validation, Model mapping and more.... If you like it, please ★ ⇧
qData is a lightweight, feature-complete, AI-native open-source data platform. It covers data integration, development, modeling, governance, assets and API services, with self-hosted deployment, flexible scaling and commercial use.
📈 Collect customer event data from your apps. (Note that this project only includes the API collector, not the visualization platform)
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
AtlasMap project repository
RDF-Centric Map/Reduce Framework and Freebase data conversion tool
Hadoop Data Integration with various databases, ftp servers, salesforce. Incremental update, dedup, append, merge your data on Hadoop.
Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.
HBase adapters for Cascading
Read JMeter results in a csv file and put results in Influxdb database and allows you to create beautiful graphs with Grafana