AwesomeRepos
Sign in

Tags / Data pipelines and messaging /

ETL

A tool that extracts data from sources, transforms it, and loads it into a destination, including ELT and connectors.

The 105repositories with this Tag gained +2,073 net stars in the last 30 days, 3% less than the 30 days before.

1 created in the last 90 days · 30 published a release in the last 30 days · 346K stars in total

All in the Repository Index On Trending

Net stars each day, last 30 days+375 last 7 days

Oct 6, 2026Nov 4, 2026

Most net stars, last 30 days

hugues31/duckpad

The data transformation tool the open-source community deserves.

+306

15% of the net stars of this Tag

Largest Pace, last 30 days

No other repository gained 2 or more times the net stars of the 30 days before.

Most stars, created in the last 90 days

No other repository with this Tag was created in the last 90 days.

Where the stars went, last 13 weeks

Net stars gained each week. The repositories that gained the most have their own color.

cocoindex-io/cocoindex gained 10% of the net stars of this Tag in the last 13 weeks.

cocoindex-io/cocoindex, week to Aug 12: +109 net starsslothflowlabs/duckle, week to Aug 12: +60 net starsdbt-labs/dbt, week to Aug 12: +49 net starsairbytehq/airbyte, week to Aug 12: +92 net starsthe-momentum/open-wearables, week to Aug 12: +39 net starsAll other repositories, week to Aug 12: +297 net starscocoindex-io/cocoindex, week to Aug 19: +77 net starsslothflowlabs/duckle, week to Aug 19: +153 net starsdbt-labs/dbt, week to Aug 19: +39 net starsairbytehq/airbyte, week to Aug 19: +45 net starsthe-momentum/open-wearables, week to Aug 19: +41 net starsAll other repositories, week to Aug 19: +264 net starscocoindex-io/cocoindex, week to Aug 26: +54 net starsslothflowlabs/duckle, week to Aug 26: +74 net starsdbt-labs/dbt, week to Aug 26: +35 net starsairbytehq/airbyte, week to Aug 26: +47 net starsthe-momentum/open-wearables, week to Aug 26: +41 net starsAll other repositories, week to Aug 26: +278 net starscocoindex-io/cocoindex, week to Sep 2: +50 net starsslothflowlabs/duckle, week to Sep 2: +30 net starsdbt-labs/dbt, week to Sep 2: +77 net starsairbytehq/airbyte, week to Sep 2: +28 net starsthe-momentum/open-wearables, week to Sep 2: +32 net starsAll other repositories, week to Sep 2: +383 net starscocoindex-io/cocoindex, week to Sep 9: +69 net starsslothflowlabs/duckle, week to Sep 9: +24 net starsdbt-labs/dbt, week to Sep 9: +25 net starsairbytehq/airbyte, week to Sep 9: +43 net starsthe-momentum/open-wearables, week to Sep 9: +42 net starsAll other repositories, week to Sep 9: +266 net starscocoindex-io/cocoindex, week to Sep 16: +47 net starsslothflowlabs/duckle, week to Sep 16: +20 net starsdbt-labs/dbt, week to Sep 16: +52 net starsairbytehq/airbyte, week to Sep 16: +58 net starsthe-momentum/open-wearables, week to Sep 16: +32 net starsAll other repositories, week to Sep 16: +294 net starscocoindex-io/cocoindex, week to Sep 23: +33 net starsslothflowlabs/duckle, week to Sep 23: +21 net starsdbt-labs/dbt, week to Sep 23: +79 net starsairbytehq/airbyte, week to Sep 23: +53 net starsthe-momentum/open-wearables, week to Sep 23: +40 net starsAll other repositories, week to Sep 23: +309 net starscocoindex-io/cocoindex, week to Sep 30: +53 net starsslothflowlabs/duckle, week to Sep 30: +21 net starsdbt-labs/dbt, week to Sep 30: +39 net starsairbytehq/airbyte, week to Sep 30: +34 net starsthe-momentum/open-wearables, week to Sep 30: +36 net starsAll other repositories, week to Sep 30: +303 net starscocoindex-io/cocoindex, week to Oct 7: +16 net starsslothflowlabs/duckle, week to Oct 7: +150 net starsdbt-labs/dbt, week to Oct 7: +31 net starsairbytehq/airbyte, week to Oct 7: +39 net starsthe-momentum/open-wearables, week to Oct 7: +28 net starsAll other repositories, week to Oct 7: +220 net starscocoindex-io/cocoindex, week to Oct 14: +66 net starsslothflowlabs/duckle, week to Oct 14: +12 net starsdbt-labs/dbt, week to Oct 14: +48 net starsairbytehq/airbyte, week to Oct 14: +42 net starsthe-momentum/open-wearables, week to Oct 14: +44 net starsAll other repositories, week to Oct 14: +312 net starscocoindex-io/cocoindex, week to Oct 21: +38 net starsslothflowlabs/duckle, week to Oct 21: +22 net starsdbt-labs/dbt, week to Oct 21: +44 net starsairbytehq/airbyte, week to Oct 21: +37 net starsthe-momentum/open-wearables, week to Oct 21: +42 net starsAll other repositories, week to Oct 21: +267 net starscocoindex-io/cocoindex, week to Oct 28: +40 net starsslothflowlabs/duckle, week to Oct 28: +15 net starsdbt-labs/dbt, week to Oct 28: +40 net starsairbytehq/airbyte, week to Oct 28: +30 net starsthe-momentum/open-wearables, week to Oct 28: +32 net starsAll other repositories, week to Oct 28: +429 net starscocoindex-io/cocoindex, week to Nov 4: +51 net starsslothflowlabs/duckle, week to Nov 4: +16 net starsdbt-labs/dbt, week to Nov 4: +25 net starsairbytehq/airbyte, week to Nov 4: +33 net starsthe-momentum/open-wearables, week to Nov 4: +31 net starsAll other repositories, week to Nov 4: +219 net stars

Compare growth

46 of 105 repositories: The newest GitHub release is more than 180 days old. A repository that never published a release is not in this list. Select a column name to change the order.

#RepositoryStarsGained, 30 daysPace
1airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

22K+1590.8×
2alibaba/DataX

TranslatedDataX is the open-source version of Alibaba Cloud DataWorks Data Integration.

17K+35–
3pentaho/pentaho-kettle

Pentaho Data Integration ( ETL ) a.k.a Kettle

8.4K+20–
4snowplow/snowplow

The leader in Customer Data Infrastructure

7K+16–
5mozilla-services/hekaarchived

DEPRECATED: Data collection and processing made easy.

3.4K-1–
6linuxfoundation/crowd.dev

LFX Community Data Platform (CDP)

3.4K+7–
7jprante/elasticsearch-jdbcarchived

JDBC importer for Elasticsearch *** THIS REPOSITORY WILL BE DELETED WITHOUT ANY FURTHER NOTICE AFTER AUG 1 2026 ***

2.8K0–
8apache/gobblin

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

2.3K+2–
9sfu-db/dataprep

Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.

2.3K+9–
10mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

2.1K+1–
11apache/cassandra-spark-connector

Apache Spark to Apache Cassandra connector

2K0–
12yougov/mongo-connector

MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)

1.9K-2–
13embulk/embulk

Embulk: Pluggable Bulk Data Loader.

1.8K+1–
14thbar/kiba

Data processing & ETL framework for Ruby

1.8K+2–
15mongodb/mongo-hadooparchived

MongoDB Connector for Hadoop

1.5K+1–
16hi-primus/optimus

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

1.5K+1–
17lukasmartinelli/pgfutter

Import CSV and JSON into PostgreSQL the easy way

1.3K+1–
18nextgenhealthcare/connect

The swiss army knife of healthcare integration.

1.2K+11–
19jf-tech/omniparser

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

1.1K+1–
20metriport/metriport

Healthcare data infrastructure for next generation care delivery.

798+9–

Faster than the 30 days before

Net stars of the last 30 days are 2 or more times those of the 30 days before.

No repository with this Tag meets this rule now.

Slower than the 30 days before

Net stars of the last 30 days are 50% or less of those of the 30 days before.

  1. pathwaycom/pathway-0.2× · -18
  2. slothflowlabs/duckle0.3× · +75

New in the last 90 days

Created on GitHub in the last 90 days.

  1. hugues31/duckpad+306 · 11 days ago

Older than 2 years, still releasing

Created more than 2 years ago, with a push in the last 7 days and a GitHub release in the last 30 days.

  1. subquery/subql19K · release 7 days ago
  2. Unstructured-IO/unstructured16K · release 6 days ago
  3. elastic/logstash15K · release 2 days ago
  4. dbt-labs/dbt14K · release today
  5. redpanda-data/connect8.8K · release 5 days ago
All 25 in the table

Last release more than 180 days ago

The newest GitHub release is more than 180 days old. A repository that never published a release is not in this list.

  1. airbytehq/airbyte22K · release last year
  2. alibaba/DataX17K · release 3 years ago
  3. pentaho/pentaho-kettle8.4K · release 11 years ago
  4. snowplow/snowplow7K · release 4 years ago
  5. mozilla-services/heka3.4K · release 10 years ago
All 46 in the table

Top GitHub topics with this Tag

Primary languages

How a repository gets this Tag

An agent reads the description, the GitHub topics, and the start of the README of each repository. It chooses Tags only from the Tag list in the AwesomeRepos source code. For each Tag, it quotes the text. A code check keeps the Tag only when the quote is in that text. The page of each repository shows the quote of each of its Tags. A Tag does not rank repositories. It does not say that one repository can replace another. To report a wrong Tag, use "Report a problem with this page" on the page of the repository.

How the numbers are counted

All numbers come from the Star History of the repositories that have the Tag now. A period is a run of complete UTC days. All numbers on this page count only the repositories that AwesomeRepos shows in lists. A machine computes them each hour.

For each repository, a period counts only when Star History has each of its days, or when the repository was created in the period. Otherwise the table shows "–". The bars of a week with no complete data are grey.

The Pace is the net stars of a period divided by the net stars of the period before. It shows only when Star History covers each day of the period before, with at least 3 net stars a day on average.

The chart at the top adds up the net stars of all the repositories with the Tag. A rising Admission comes into the Repository Index because it gained stars quickly. Its Star History before its Admission comes from the Repository Host. Thus the days before many rising Admissions are higher than they were for the repositories in the index at that time.

The releases are the GitHub releases of each repository. The lists and the table do not rank repositories, and they do not say that one repository can replace another.