47,133 repositories indexed
1–7 of 7 · Most stars
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Embulk: Pluggable Bulk Data Loader.
📈 Collect customer event data from your apps. (Note that this project only includes the API collector, not the visualization platform)
The simple, stupid batch framework for Java
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.
Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.