AwesomeRepos
Sign in

Tags / Data pipelines and messaging /

ETL

A tool that extracts data from sources, transforms it, and loads it into a destination, including ELT and connectors.

The 109repositories with this Tag gained +2,073 net stars in the last 30 days, 3% less than the 30 days before.

1 created in the last 90 days · 31 published a release in the last 30 days · 346K stars in total

All in the Repository Index On Trending

Net stars each day, last 30 days+375 last 7 days

Oct 6, 2026Nov 4, 2026

Most net stars, last 30 days

hugues31/duckpad

The data transformation tool the open-source community deserves.

+306

15% of the net stars of this Tag

Largest Pace, last 30 days

No other repository gained 2 or more times the net stars of the 30 days before.

Most stars, created in the last 90 days

No other repository with this Tag was created in the last 90 days.

Where the stars went, last 13 weeks

Net stars gained each week. The repositories that gained the most have their own color.

cocoindex-io/cocoindex gained 10% of the net stars of this Tag in the last 13 weeks.

cocoindex-io/cocoindex, week to Aug 12: +109 net starsslothflowlabs/duckle, week to Aug 12: +60 net starsdbt-labs/dbt, week to Aug 12: +49 net starsairbytehq/airbyte, week to Aug 12: +92 net starsthe-momentum/open-wearables, week to Aug 12: +39 net starsAll other repositories, week to Aug 12: +297 net starscocoindex-io/cocoindex, week to Aug 19: +77 net starsslothflowlabs/duckle, week to Aug 19: +153 net starsdbt-labs/dbt, week to Aug 19: +39 net starsairbytehq/airbyte, week to Aug 19: +45 net starsthe-momentum/open-wearables, week to Aug 19: +41 net starsAll other repositories, week to Aug 19: +264 net starscocoindex-io/cocoindex, week to Aug 26: +54 net starsslothflowlabs/duckle, week to Aug 26: +74 net starsdbt-labs/dbt, week to Aug 26: +35 net starsairbytehq/airbyte, week to Aug 26: +47 net starsthe-momentum/open-wearables, week to Aug 26: +41 net starsAll other repositories, week to Aug 26: +278 net starscocoindex-io/cocoindex, week to Sep 2: +50 net starsslothflowlabs/duckle, week to Sep 2: +30 net starsdbt-labs/dbt, week to Sep 2: +77 net starsairbytehq/airbyte, week to Sep 2: +28 net starsthe-momentum/open-wearables, week to Sep 2: +32 net starsAll other repositories, week to Sep 2: +383 net starscocoindex-io/cocoindex, week to Sep 9: +69 net starsslothflowlabs/duckle, week to Sep 9: +24 net starsdbt-labs/dbt, week to Sep 9: +25 net starsairbytehq/airbyte, week to Sep 9: +43 net starsthe-momentum/open-wearables, week to Sep 9: +42 net starsAll other repositories, week to Sep 9: +266 net starscocoindex-io/cocoindex, week to Sep 16: +47 net starsslothflowlabs/duckle, week to Sep 16: +20 net starsdbt-labs/dbt, week to Sep 16: +52 net starsairbytehq/airbyte, week to Sep 16: +58 net starsthe-momentum/open-wearables, week to Sep 16: +32 net starsAll other repositories, week to Sep 16: +296 net starscocoindex-io/cocoindex, week to Sep 23: +33 net starsslothflowlabs/duckle, week to Sep 23: +21 net starsdbt-labs/dbt, week to Sep 23: +79 net starsairbytehq/airbyte, week to Sep 23: +53 net starsthe-momentum/open-wearables, week to Sep 23: +40 net starsAll other repositories, week to Sep 23: +309 net starscocoindex-io/cocoindex, week to Sep 30: +53 net starsslothflowlabs/duckle, week to Sep 30: +21 net starsdbt-labs/dbt, week to Sep 30: +39 net starsairbytehq/airbyte, week to Sep 30: +34 net starsthe-momentum/open-wearables, week to Sep 30: +36 net starsAll other repositories, week to Sep 30: +303 net starscocoindex-io/cocoindex, week to Oct 7: +16 net starsslothflowlabs/duckle, week to Oct 7: +150 net starsdbt-labs/dbt, week to Oct 7: +31 net starsairbytehq/airbyte, week to Oct 7: +39 net starsthe-momentum/open-wearables, week to Oct 7: +28 net starsAll other repositories, week to Oct 7: +220 net starscocoindex-io/cocoindex, week to Oct 14: +66 net starsslothflowlabs/duckle, week to Oct 14: +12 net starsdbt-labs/dbt, week to Oct 14: +48 net starsairbytehq/airbyte, week to Oct 14: +42 net starsthe-momentum/open-wearables, week to Oct 14: +44 net starsAll other repositories, week to Oct 14: +312 net starscocoindex-io/cocoindex, week to Oct 21: +38 net starsslothflowlabs/duckle, week to Oct 21: +22 net starsdbt-labs/dbt, week to Oct 21: +44 net starsairbytehq/airbyte, week to Oct 21: +37 net starsthe-momentum/open-wearables, week to Oct 21: +42 net starsAll other repositories, week to Oct 21: +267 net starscocoindex-io/cocoindex, week to Oct 28: +40 net starsslothflowlabs/duckle, week to Oct 28: +15 net starsdbt-labs/dbt, week to Oct 28: +40 net starsairbytehq/airbyte, week to Oct 28: +30 net starsthe-momentum/open-wearables, week to Oct 28: +32 net starsAll other repositories, week to Oct 28: +429 net starscocoindex-io/cocoindex, week to Nov 4: +51 net starsslothflowlabs/duckle, week to Nov 4: +16 net starsdbt-labs/dbt, week to Nov 4: +25 net starsairbytehq/airbyte, week to Nov 4: +33 net starsthe-momentum/open-wearables, week to Nov 4: +31 net starsAll other repositories, week to Nov 4: +219 net stars

Compare growth

109 repositories with this Tag. Select a column name to change the order.

#RepositoryStarsGained, 7 daysPace
41united-manufacturing-hub/united-manufacturing-hub

The data platform for manufacturing

407+1–
42atlasmap/atlasmap

AtlasMap project repository

214+1–
43Breeze0806/go-etl

go-etl is a toolset for data extraction, transformation and loading.

192+1–
44public-transport/gtfs-via-postgres

Analyse GTFS Schedule data by importing it into a PostgreSQL database.

148+1–
45jprante/elasticsearch-jdbcarchived

JDBC importer for Elasticsearch *** THIS REPOSITORY WILL BE DELETED WITHOUT ANY FURTHER NOTICE AFTER AUG 1 2026 ***

2.8K0–
46apache/gobblin

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

2.3K0–
47sfu-db/dataprep

Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.

2.3K0–
48mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

2.1K0–
49elastic/elasticsearch-hadoop

:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop

2K0–
50apache/cassandra-spark-connector

Apache Spark to Apache Cassandra connector

2K0–
51pinterest/secorarchived

Secor is a service implementing Kafka log persistence

1.9K0–
52embulk/embulk

Embulk: Pluggable Bulk Data Loader.

1.8K0–
53thbar/kiba

Data processing & ETL framework for Ruby

1.8K0–
54mongodb/mongo-hadooparchived

MongoDB Connector for Hadoop

1.5K0–
55hi-primus/optimus

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

1.5K0–
56apache/inlong

Apache InLong - a one-stop, full-scenario integration framework for massive data

1.5K0–
57arkflow-rs/arkflow

High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.

1.3K0–
58LinkedInAttic/camusarchived

LinkedIn's previous generation Kafka to HDFS pipeline.

8790–
59Cinchoo/ChoETL

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

8610–
60rakam-io/rakam-api

📈 Collect customer event data from your apps. (Note that this project only includes the API collector, not the visualization platform)

7890–

Faster than the 30 days before

Net stars of the last 30 days are 2 or more times those of the 30 days before.

No repository with this Tag meets this rule now.

Slower than the 30 days before

Net stars of the last 30 days are 50% or less of those of the 30 days before.

  1. pathwaycom/pathway-0.2× · -18
  2. slothflowlabs/duckle0.3× · +75

New in the last 90 days

Created on GitHub in the last 90 days.

  1. hugues31/duckpad+306 · 11 days ago

Older than 2 years, still releasing

Created more than 2 years ago, with a push in the last 7 days and a GitHub release in the last 30 days.

  1. subquery/subql19K · release 7 days ago
  2. Unstructured-IO/unstructured16K · release 6 days ago
  3. elastic/logstash15K · release 2 days ago
  4. dbt-labs/dbt14K · release yesterday
  5. redpanda-data/connect8.8K · release 5 days ago
All 26 in the table

Last release more than 180 days ago

The newest GitHub release is more than 180 days old. A repository that never published a release is not in this list.

  1. airbytehq/airbyte22K · release last year
  2. alibaba/DataX17K · release 3 years ago
  3. pentaho/pentaho-kettle8.4K · release 11 years ago
  4. snowplow/snowplow7K · release 4 years ago
  5. mozilla-services/heka3.4K · release 10 years ago
All 47 in the table

Top GitHub topics with this Tag

Primary languages

How a repository gets this Tag

An agent reads the description, the GitHub topics, and the start of the README of each repository. It chooses Tags only from the Tag list in the AwesomeRepos source code. For each Tag, it quotes the text. A code check keeps the Tag only when the quote is in that text. The page of each repository shows the quote of each of its Tags. A Tag does not rank repositories. It does not say that one repository can replace another. To report a wrong Tag, use "Report a problem with this page" on the page of the repository.

How the numbers are counted

All numbers come from the Star History of the repositories that have the Tag now. A period is a run of complete UTC days. All numbers on this page count only the repositories that AwesomeRepos shows in lists. A machine computes them each hour.

For each repository, a period counts only when Star History has each of its days, or when the repository was created in the period. Otherwise the table shows "–". The bars of a week with no complete data are grey.

The Pace is the net stars of a period divided by the net stars of the period before. It shows only when Star History covers each day of the period before, with at least 3 net stars a day on average.

The chart at the top adds up the net stars of all the repositories with the Tag. A rising Admission comes into the Repository Index because it gained stars quickly. Its Star History before its Admission comes from the Repository Host. Thus the days before many rising Admissions are higher than they were for the repositories in the index at that time.

The releases are the GitHub releases of each repository. The lists and the table do not rank repositories, and they do not say that one repository can replace another.