Sign in

Repository Index

132,241 visible repositories in the index

Tags: ETL
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

73–96 of 129 · Most stars

Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

  • integration
  • reactive
  • akka
  • akka-stream

Open Source research tool to search, browse, analyze and explore large document collections by Semantic Search Engine and Open Source Text Mining & Text Analytics platform (Integrates ETL for document processing, OCR for images & PDF, named entity recognition for persons, organizations & locations, metadata management by thesaurus & ontologies, search user interface & search apps for fulltext search, faceted search & knowledge graph)

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

DataLink是一个满足各种异构数据源之间的实时增量同步、离线全量同步,分布式、可扩展的数据交换平台。

  • data-replication
  • datalink
  • data-exchange
  • realtime-replication

Intake is a lightweight package for finding, investigating, loading and disseminating data.

  • python
  • data-access
  • data-catalog

MetaForge is integrated software for data transformation, integration, and visualization. Support a variety of data sources, file types, big data related database, relational database, NoSQL database, etc. Through the software can realize the management of multiple data sources, the data under the source of various operations conversion, making dat

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

:lipstick: Durable and asynchronous data imports for consuming data at scale and publishing testable SDKs.

  • porter
  • data-import
  • framework
  • data-transformation

The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.

An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration

  • java
  • smooks
  • enterprise-integration
  • etl

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

  • spark
  • neo4j-connector
  • cypher
  • neo4j-driver

Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models. Uses RemoteTable gem internally.