AwesomeRepos
Sign in

Tags / Data pipelines and messaging /

ETL

A tool that extracts data from sources, transforms it, and loads it into a destination, including ELT and connectors.

The 123repositories with this Tag gained +2,082 net stars in the last 30 days, 3% less than the 30 days before.

1 created in the last 90 days · 33 published a release in the last 30 days · 347K stars in total

All in the Repository Index On Trending

Net stars each day, last 30 days+377 last 7 days

Oct 6, 2026Nov 4, 2026

Most net stars, last 30 days

hugues31/duckpad

The data transformation tool the open-source community deserves.

+306

15% of the net stars of this Tag

Largest Pace, last 30 days

No other repository gained 2 or more times the net stars of the 30 days before.

Most stars, created in the last 90 days

No other repository with this Tag was created in the last 90 days.

Where the stars went, last 13 weeks

Net stars gained each week. The repositories that gained the most have their own color.

cocoindex-io/cocoindex gained 10% of the net stars of this Tag in the last 13 weeks.

cocoindex-io/cocoindex, week to Aug 12: +109 net starsslothflowlabs/duckle, week to Aug 12: +60 net starsdbt-labs/dbt, week to Aug 12: +49 net starsairbytehq/airbyte, week to Aug 12: +92 net starsthe-momentum/open-wearables, week to Aug 12: +39 net starsAll other repositories, week to Aug 12: +299 net starscocoindex-io/cocoindex, week to Aug 19: +77 net starsslothflowlabs/duckle, week to Aug 19: +153 net starsdbt-labs/dbt, week to Aug 19: +39 net starsairbytehq/airbyte, week to Aug 19: +45 net starsthe-momentum/open-wearables, week to Aug 19: +41 net starsAll other repositories, week to Aug 19: +266 net starscocoindex-io/cocoindex, week to Aug 26: +54 net starsslothflowlabs/duckle, week to Aug 26: +74 net starsdbt-labs/dbt, week to Aug 26: +35 net starsairbytehq/airbyte, week to Aug 26: +47 net starsthe-momentum/open-wearables, week to Aug 26: +41 net starsAll other repositories, week to Aug 26: +284 net starscocoindex-io/cocoindex, week to Sep 2: +50 net starsslothflowlabs/duckle, week to Sep 2: +30 net starsdbt-labs/dbt, week to Sep 2: +77 net starsairbytehq/airbyte, week to Sep 2: +28 net starsthe-momentum/open-wearables, week to Sep 2: +32 net starsAll other repositories, week to Sep 2: +405 net starscocoindex-io/cocoindex, week to Sep 9: +69 net starsslothflowlabs/duckle, week to Sep 9: +24 net starsdbt-labs/dbt, week to Sep 9: +25 net starsairbytehq/airbyte, week to Sep 9: +43 net starsthe-momentum/open-wearables, week to Sep 9: +42 net starsAll other repositories, week to Sep 9: +276 net starscocoindex-io/cocoindex, week to Sep 16: +47 net starsslothflowlabs/duckle, week to Sep 16: +20 net starsdbt-labs/dbt, week to Sep 16: +52 net starsairbytehq/airbyte, week to Sep 16: +58 net starsthe-momentum/open-wearables, week to Sep 16: +32 net starsAll other repositories, week to Sep 16: +297 net starscocoindex-io/cocoindex, week to Sep 23: +33 net starsslothflowlabs/duckle, week to Sep 23: +21 net starsdbt-labs/dbt, week to Sep 23: +79 net starsairbytehq/airbyte, week to Sep 23: +53 net starsthe-momentum/open-wearables, week to Sep 23: +40 net starsAll other repositories, week to Sep 23: +310 net starscocoindex-io/cocoindex, week to Sep 30: +53 net starsslothflowlabs/duckle, week to Sep 30: +21 net starsdbt-labs/dbt, week to Sep 30: +39 net starsairbytehq/airbyte, week to Sep 30: +34 net starsthe-momentum/open-wearables, week to Sep 30: +36 net starsAll other repositories, week to Sep 30: +303 net starscocoindex-io/cocoindex, week to Oct 7: +16 net starsslothflowlabs/duckle, week to Oct 7: +150 net starsdbt-labs/dbt, week to Oct 7: +31 net starsairbytehq/airbyte, week to Oct 7: +39 net starsthe-momentum/open-wearables, week to Oct 7: +28 net starsAll other repositories, week to Oct 7: +222 net starscocoindex-io/cocoindex, week to Oct 14: +66 net starsslothflowlabs/duckle, week to Oct 14: +12 net starsdbt-labs/dbt, week to Oct 14: +48 net starsairbytehq/airbyte, week to Oct 14: +42 net starsthe-momentum/open-wearables, week to Oct 14: +44 net starsAll other repositories, week to Oct 14: +314 net starscocoindex-io/cocoindex, week to Oct 21: +38 net starsslothflowlabs/duckle, week to Oct 21: +22 net starsdbt-labs/dbt, week to Oct 21: +44 net starsairbytehq/airbyte, week to Oct 21: +37 net starsthe-momentum/open-wearables, week to Oct 21: +42 net starsAll other repositories, week to Oct 21: +271 net starscocoindex-io/cocoindex, week to Oct 28: +40 net starsslothflowlabs/duckle, week to Oct 28: +15 net starsdbt-labs/dbt, week to Oct 28: +40 net starsairbytehq/airbyte, week to Oct 28: +30 net starsthe-momentum/open-wearables, week to Oct 28: +32 net starsAll other repositories, week to Oct 28: +432 net starscocoindex-io/cocoindex, week to Nov 4: +51 net starsslothflowlabs/duckle, week to Nov 4: +16 net starsdbt-labs/dbt, week to Nov 4: +25 net starsairbytehq/airbyte, week to Nov 4: +33 net starsthe-momentum/open-wearables, week to Nov 4: +31 net starsAll other repositories, week to Nov 4: +221 net stars

Compare growth

123 repositories with this Tag. Select a column name to change the order.

#RepositoryStarsGained, 90 daysPace
81Stratio/Spark-MongoDBarchived

Spark library for easy MongoDB access

3060–
82paulhoule/infovore

RDF-Centric Map/Reduce Framework and Freebase data conversion tool

1480–
83sonalgoyal/hiho

Hadoop Data Integration with various databases, ftp servers, salesforce. Incremental update, dedup, append, merge your data on Hadoop.

910–
84typedb-osi/typedb-loaderarchived

TypeDB Loader - Data Migration Tool for TypeDB

670–
85hishamkaram/gismanager

Go tool + library that publishes GIS vector data to GeoServer via PostGIS — walks a directory of shapefile / GeoJSON / GeoPackage / KML, loads each into PostGIS via GDAL/OGR, then registers the resulting tables as GeoServer feature types. Idempotent. Tested on GeoServer 2.27 LTS + 2.28 stable.

540–
86sidneycadot/oeis

Code to download, process, and analyse the Online Encyclopedia of Integer Sequences

510–
87algorand/conduit

Algorand's data pipeline framework.

440–
88mozilla-services/hekaarchived

DEPRECATED: Data collection and processing made easy.

3.4K-1–
89yougov/mongo-connector

MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)

1.9K-1–
90IFTTT/polo

Polo travels through your database and creates sample snapshots so you can work with real world data in development.

787-1–
91spring-attic/spring-xdarchived

Spring XD makes it easy to solve common big data problems such as data ingestion and export, real-time analytics, and batch workflow orchestration

473-1–
92JupiterOne/starbase

Graph-based security analysis for everyone

361-1–
93LinkedInAttic/camusarchived

LinkedIn's previous generation Kafka to HDFS pipeline.

879––
94rakam-io/rakam-api

📈 Collect customer event data from your apps. (Note that this project only includes the API collector, not the visualization platform)

789––
95awslabs/aws-lambda-redshift-loader

Amazon Redshift Database Loader implemented in AWS Lambda

595––
96dotnetcore/SmartCode

SmartCode = IDataSource -> IBuildTask -> IOutput => Build Everything!!!

576––
97hortonworks-spark/shc

The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.

545––
98seamusabshere/data_miner

Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models. Uses RemoteTable gem internally.

305––
99jexp/neo4j-shell-toolsarchived

A bunch of import/export tools for the neo4j-shell

290––
100graphaware/neo4j-to-elasticsearcharchived

GraphAware Framework Module for Integrating Neo4j with Elasticsearch

266––

Faster than the 30 days before

Net stars of the last 30 days are 2 or more times those of the 30 days before.

No repository with this Tag meets this rule now.

Slower than the 30 days before

Net stars of the last 30 days are 50% or less of those of the 30 days before.

  1. pathwaycom/pathway-0.2× · -18
  2. slothflowlabs/duckle0.3× · +75

New in the last 90 days

Created on GitHub in the last 90 days.

  1. hugues31/duckpad+306 · 11 days ago

Older than 2 years, still releasing

Created more than 2 years ago, with a push in the last 7 days and a GitHub release in the last 30 days.

  1. subquery/subql19K · release 7 days ago
  2. Unstructured-IO/unstructured16K · release 6 days ago
  3. elastic/logstash15K · release 3 days ago
  4. dbt-labs/dbt14K · release yesterday
  5. redpanda-data/connect8.8K · release 5 days ago
All 26 in the table

Last release more than 180 days ago

The newest GitHub release is more than 180 days old. A repository that never published a release is not in this list.

  1. airbytehq/airbyte22K · release last year
  2. alibaba/DataX17K · release 3 years ago
  3. pentaho/pentaho-kettle8.4K · release 11 years ago
  4. snowplow/snowplow7K · release 4 years ago
  5. mozilla-services/heka3.4K · release 10 years ago
All 51 in the table

Top GitHub topics with this Tag

Primary languages

How a repository gets this Tag

An agent reads the description, the GitHub topics, and the start of the README of each repository. It chooses Tags only from the Tag list in the AwesomeRepos source code. For each Tag, it quotes the text. A code check keeps the Tag only when the quote is in that text. The page of each repository shows the quote of each of its Tags. A Tag does not rank repositories. It does not say that one repository can replace another. To report a wrong Tag, use "Report a problem with this page" on the page of the repository.

How the numbers are counted

All numbers come from the Star History of the repositories that have the Tag now. A period is a run of complete UTC days. All numbers on this page count only the repositories that AwesomeRepos shows in lists. A machine computes them each hour.

For each repository, a period counts only when Star History has each of its days, or when the repository was created in the period. Otherwise the table shows "–". The bars of a week with no complete data are grey.

The Pace is the net stars of a period divided by the net stars of the period before. It shows only when Star History covers each day of the period before, with at least 3 net stars a day on average.

The chart at the top adds up the net stars of all the repositories with the Tag. A rising Admission comes into the Repository Index because it gained stars quickly. Its Star History before its Admission comes from the Repository Host. Thus the days before many rising Admissions are higher than they were for the repositories in the index at that time.

The releases are the GitHub releases of each repository. The lists and the table do not rank repositories, and they do not say that one repository can replace another.