Logstash - transport and process your logs, events, or other data
Repository Index
132,241 visible repositories in the index
1–24 of 41 · Most stars
OpenRefine is a free, open source power tool for working with messy data and improving it
- datacleansing
- data-analysis
- java
- opendata
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
Enso Analytics is a self-service data prep and analysis platform designed for data teams.
Flink CDC is a streaming data integration tool
- change-data-capture
- cdc
- batch
- data-integration
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
- camel
- integration
- java
- microservices
TranslatedDataX integrated with a visual page: select a data source and generate a data synchronization task with one click. Supports data sources such as RDBMS, Hive, HBase, ClickHouse, and MongoDB, and batch creation of RDBMS data synchronization tasks. Integrates an open-source scheduling system, and supports distributed and incremental data synchronization, real-time viewing of running logs, monitoring of executor resources, KILL of running processes, encryption of data source information, and more.
A data integration framework
The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common framework, including data models and protocols, to enable direct transfer of data both into and out of participating online service providers.
- data
- transfer
- portability
- data-portability
Database Subsetting and Relational Data Browsing Tool.
🔥🔥 AllData大模型与AI数据底座,以数据平台为底座,以数据中台为桥梁,以机器学习平台为工厂,以大模型应用为上游产品,提供全链路数字化解决方案。 产品手册:https://www.yuque.com/aolingdata/product 产品演示+AI社群+商务采购:https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo
- paimon
- datart
- dinky
- streampark
Spring Batch is a framework for writing batch applications using Java and Spring
- batch
- batch-processing
- java
- spring
阿里巴巴去Oracle数据迁移同步工具(全量+增量,目标支持MySQL/DRDS)
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
- data
- ingestion
- replication
- management
LarkMidTable 是一站式开源的数据中台,实现中台的 基础建设,数据治理,数据开发,监控告警,数据服务,数据的可视化,实现高效赋能数据前台并提供数据服务的产品。
- flink
- flinkx
- seatunnel
- datax
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
Embulk: Pluggable Bulk Data Loader.
- embulk
- bulk-loader
The ToroDB solution to provide better analytics on top of MongoDB and make it easier to migrate from MongoDB to SQL
Hop Orchestration Platform
- java
- streaming
- hop
- apache
Apache InLong - a one-stop, full-scenario integration framework for massive data
- inlong
- one-stop-service
- data-streaming
- event-streaming
Elasticsearch File System Crawler (FS Crawler)
- java
- elasticsearch
- crawler
- tika
Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.
- hadoop
- hive
- database
- clickhouse
Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
- apache-beam
- dataflow-templates
- google-cloud-dataflow
- google-cloud-storage
The swiss army knife of healthcare integration.
- mirth
- mirth-connect
- hl7
- healthcare