47,133 repositories indexed
1–4 of 4 · Most stars
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.
An import river similar to the elasticsearch mysql river