SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
108,094 visible repositories in the index
1–22 of 22 · Most stars
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Enso Analytics is a self-service data prep and analysis platform designed for data teams.
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
TranslatedDataX integrated with a visual page: select a data source and generate a data synchronization task with one click. Supports data sources such as RDBMS, Hive, HBase, ClickHouse, and MongoDB, and batch creation of RDBMS data synchronization tasks. Integrates an open-source scheduling system, and supports distributed and incremental data synchronization, real-time viewing of running logs, monitoring of executor resources, KILL of running processes, encryption of data source information, and more.
The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common framework, including data models and protocols, to enable direct transfer of data both into and out of participating online service providers.
Database Subsetting and Relational Data Browsing Tool.
🔥🔥 AllData大模型与AI数据底座,以数据平台为底座,以数据中台为桥梁,以机器学习平台为工厂,以大模型应用为上游产品,提供全链路数字化解决方案。 产品手册:https://www.yuque.com/aolingdata/product 产品演示+AI社群+商务采购:https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo
LarkMidTable 是一站式开源的数据中台,实现中台的 基础建设,数据治理,数据开发,监控告警,数据服务,数据的可视化,实现高效赋能数据前台并提供数据服务的产品。
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
The ToroDB solution to provide better analytics on top of MongoDB and make it easier to migrate from MongoDB to SQL
Apache InLong - a one-stop, full-scenario integration framework for massive data
Elasticsearch File System Crawler (FS Crawler)
Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.
Support agile Ontology DataOps Based on Flink, DataX and Flink-CDC with Web-UI
📈 Collect customer event data from your apps. (Note that this project only includes the API collector, not the visualization platform)
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
RDF-Centric Map/Reduce Framework and Freebase data conversion tool
Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.
Hadoop Data Integration with various databases, ftp servers, salesforce. Incremental update, dedup, append, merge your data on Hadoop.
Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.
HBase adapters for Cascading
Read JMeter results in a csv file and put results in Influxdb database and allows you to create beautiful graphs with Grafana