Logstash - transport and process your logs, events, or other data
Repository Index
77,353 visible repositories in the index
1–19 of 19 · Most stars
OpenRefine is a free, open source power tool for working with messy data and improving it
- datacleansing
- data-analysis
- java
- opendata
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
Enso Analytics is a self-service data prep and analysis platform designed for data teams.
Flink CDC is a streaming data integration tool
- change-data-capture
- cdc
- batch
- data-integration
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
- camel
- integration
- java
- microservices
TranslatedDataX integrated with a visual page: select a data source and generate a data synchronization task with one click. Supports data sources such as RDBMS, Hive, HBase, ClickHouse, and MongoDB, and batch creation of RDBMS data synchronization tasks. Integrates an open-source scheduling system, and supports distributed and incremental data synchronization, real-time viewing of running logs, monitoring of executor resources, KILL of running processes, encryption of data source information, and more.
The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common framework, including data models and protocols, to enable direct transfer of data both into and out of participating online service providers.
- data
- transfer
- portability
- data-portability
Database Subsetting and Relational Data Browsing Tool.
🔥🔥 AllData大模型与AI数据底座，以数据平台为底座，以数据中台为桥梁，以机器学习平台为工厂，以大模型应用为上游产品，提供全链路数字化解决方案。 产品手册：https://www.yuque.com/aolingdata/product 产品演示+AI社群+商务采购：https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo
- paimon
- datart
- dinky
- streampark
Spring Batch is a framework for writing batch applications using Java and Spring
- batch
- batch-processing
- java
- spring
阿里巴巴去Oracle数据迁移同步工具(全量+增量,目标支持MySQL/DRDS)
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
- data
- ingestion
- replication
- management
Apache InLong - a one-stop, full-scenario integration framework for massive data
- inlong
- one-stop-service
- data-streaming
- event-streaming
The MongoDB Spark Connector
The simple, stupid batch framework for Java
- java
- batch-processing
- batch
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
- java
- smooks
- enterprise-integration
- etl
Flume NG MongoDB source.
- flume
- sink
- mongodb
HBase adapters for Cascading