OpenRefine is a free, open source power tool for working with messy data and improving it
- datacleansing
- data-analysis
- java
- opendata
100,822 visible repositories in the index
1–18 of 18 · Most stars
OpenRefine is a free, open source power tool for working with messy data and improving it
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Enso Analytics is a self-service data prep and analysis platform designed for data teams.
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
The Data Transfer Project makes it easy for platforms to build interoperable user data portability features. We are establishing a common framework, including data models and protocols, to enable direct transfer of data both into and out of participating online service providers.
Spring Batch is a framework for writing batch applications using Java and Spring
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Hop Orchestration Platform
Apache InLong - a one-stop, full-scenario integration framework for massive data
Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.
Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
📈 Collect customer event data from your apps. (Note that this project only includes the API collector, not the visualization platform)
The simple, stupid batch framework for Java
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.
Hadoop Data Integration with various databases, ftp servers, salesforce. Incremental update, dedup, append, merge your data on Hadoop.
Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.
HBase adapters for Cascading