Sign in

Repository Index

105,102 visible repositories in the index

Tags: ETL
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

97–120 of 171 · Most stars

High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.

  • flow
  • rust
  • rust-lang
  • stream

Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

  • integration
  • reactive
  • akka
  • akka-stream

Open Source research tool to search, browse, analyze and explore large document collections by Semantic Search Engine and Open Source Text Mining & Text Analytics platform (Integrates ETL for document processing, OCR for images & PDF, named entity recognition for persons, organizations & locations, metadata management by thesaurus & ontologies, search user interface & search apps for fulltext search, faceted search & knowledge graph)

Python Fast Dataflow programming framework for Data pipeline work( Web Crawler,Machine Learning,Quantitative Trading.etc)

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

  • transform
  • etl
  • xml
  • json

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

:lipstick: Durable and asynchronous data imports for consuming data at scale and publishing testable SDKs.

  • porter
  • data-import
  • framework
  • data-transformation

The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.

An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration

  • java
  • smooks
  • enterprise-integration
  • etl