AwesomeRepos
Sign in

Tags / Data pipelines and messaging /

ETL

A tool that extracts data from sources, transforms it, and loads it into a destination, including ELT and connectors.

The 112repositories with this Tag gained +2,073 net stars in the last 30 days, 3% less than the 30 days before.

1 created in the last 90 days · 31 published a release in the last 30 days · 347K stars in total

All in the Repository Index On Trending

Net stars each day, last 30 days+375 last 7 days

Oct 6, 2026Nov 4, 2026

Most net stars, last 30 days

hugues31/duckpad

The data transformation tool the open-source community deserves.

+306

15% of the net stars of this Tag

Largest Pace, last 30 days

No other repository gained 2 or more times the net stars of the 30 days before.

Most stars, created in the last 90 days

No other repository with this Tag was created in the last 90 days.

Where the stars went, last 13 weeks

Net stars gained each week. The repositories that gained the most have their own color.

cocoindex-io/cocoindex gained 10% of the net stars of this Tag in the last 13 weeks.

cocoindex-io/cocoindex, week to Aug 12: +109 net starsslothflowlabs/duckle, week to Aug 12: +60 net starsdbt-labs/dbt, week to Aug 12: +49 net starsairbytehq/airbyte, week to Aug 12: +92 net starsthe-momentum/open-wearables, week to Aug 12: +39 net starsAll other repositories, week to Aug 12: +297 net starscocoindex-io/cocoindex, week to Aug 19: +77 net starsslothflowlabs/duckle, week to Aug 19: +153 net starsdbt-labs/dbt, week to Aug 19: +39 net starsairbytehq/airbyte, week to Aug 19: +45 net starsthe-momentum/open-wearables, week to Aug 19: +41 net starsAll other repositories, week to Aug 19: +264 net starscocoindex-io/cocoindex, week to Aug 26: +54 net starsslothflowlabs/duckle, week to Aug 26: +74 net starsdbt-labs/dbt, week to Aug 26: +35 net starsairbytehq/airbyte, week to Aug 26: +47 net starsthe-momentum/open-wearables, week to Aug 26: +41 net starsAll other repositories, week to Aug 26: +278 net starscocoindex-io/cocoindex, week to Sep 2: +50 net starsslothflowlabs/duckle, week to Sep 2: +30 net starsdbt-labs/dbt, week to Sep 2: +77 net starsairbytehq/airbyte, week to Sep 2: +28 net starsthe-momentum/open-wearables, week to Sep 2: +32 net starsAll other repositories, week to Sep 2: +383 net starscocoindex-io/cocoindex, week to Sep 9: +69 net starsslothflowlabs/duckle, week to Sep 9: +24 net starsdbt-labs/dbt, week to Sep 9: +25 net starsairbytehq/airbyte, week to Sep 9: +43 net starsthe-momentum/open-wearables, week to Sep 9: +42 net starsAll other repositories, week to Sep 9: +266 net starscocoindex-io/cocoindex, week to Sep 16: +47 net starsslothflowlabs/duckle, week to Sep 16: +20 net starsdbt-labs/dbt, week to Sep 16: +52 net starsairbytehq/airbyte, week to Sep 16: +58 net starsthe-momentum/open-wearables, week to Sep 16: +32 net starsAll other repositories, week to Sep 16: +296 net starscocoindex-io/cocoindex, week to Sep 23: +33 net starsslothflowlabs/duckle, week to Sep 23: +21 net starsdbt-labs/dbt, week to Sep 23: +79 net starsairbytehq/airbyte, week to Sep 23: +53 net starsthe-momentum/open-wearables, week to Sep 23: +40 net starsAll other repositories, week to Sep 23: +309 net starscocoindex-io/cocoindex, week to Sep 30: +53 net starsslothflowlabs/duckle, week to Sep 30: +21 net starsdbt-labs/dbt, week to Sep 30: +39 net starsairbytehq/airbyte, week to Sep 30: +34 net starsthe-momentum/open-wearables, week to Sep 30: +36 net starsAll other repositories, week to Sep 30: +303 net starscocoindex-io/cocoindex, week to Oct 7: +16 net starsslothflowlabs/duckle, week to Oct 7: +150 net starsdbt-labs/dbt, week to Oct 7: +31 net starsairbytehq/airbyte, week to Oct 7: +39 net starsthe-momentum/open-wearables, week to Oct 7: +28 net starsAll other repositories, week to Oct 7: +220 net starscocoindex-io/cocoindex, week to Oct 14: +66 net starsslothflowlabs/duckle, week to Oct 14: +12 net starsdbt-labs/dbt, week to Oct 14: +48 net starsairbytehq/airbyte, week to Oct 14: +42 net starsthe-momentum/open-wearables, week to Oct 14: +44 net starsAll other repositories, week to Oct 14: +312 net starscocoindex-io/cocoindex, week to Oct 21: +38 net starsslothflowlabs/duckle, week to Oct 21: +22 net starsdbt-labs/dbt, week to Oct 21: +44 net starsairbytehq/airbyte, week to Oct 21: +37 net starsthe-momentum/open-wearables, week to Oct 21: +42 net starsAll other repositories, week to Oct 21: +267 net starscocoindex-io/cocoindex, week to Oct 28: +40 net starsslothflowlabs/duckle, week to Oct 28: +15 net starsdbt-labs/dbt, week to Oct 28: +40 net starsairbytehq/airbyte, week to Oct 28: +30 net starsthe-momentum/open-wearables, week to Oct 28: +32 net starsAll other repositories, week to Oct 28: +429 net starscocoindex-io/cocoindex, week to Nov 4: +51 net starsslothflowlabs/duckle, week to Nov 4: +16 net starsdbt-labs/dbt, week to Nov 4: +25 net starsairbytehq/airbyte, week to Nov 4: +33 net starsthe-momentum/open-wearables, week to Nov 4: +31 net starsAll other repositories, week to Nov 4: +219 net stars

Compare growth

112 repositories with this Tag. Select a column name to change the order.

#RepositoryStarsGained, 90 daysPace
41ankane/pgsync

Sync data from one Postgres database to another

3.5K+16–
42ConduitIO/conduit

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

617+16–
43apache/inlong

Apache InLong - a one-stop, full-scenario integration framework for massive data

1.5K+15–
44aws/aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

4.1K+14–
45subquery/subql

SubQuery is an Open, Flexible, Fast and Universal data indexing framework for web3. Our mission is to help developers create the decentralised products of the future.

19K+7–
46apache/cassandra-spark-connector

Apache Spark to Apache Cassandra connector

2K+7–
47implerhq/impler.io

Powerful CSV & Excel Import experience for SaaS 🚀 Save months building data import experience from scratch 💰

294+7–
48apache/gobblin

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

2.3K+6–
49mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

2.1K+6–
50jf-tech/omniparser

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

1.1K+6–
51smooks/smooks

An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration

422+5–
52chronicle-app/chronicle-etl

📜 A CLI toolkit for extracting and working with your digital history

200+5–
53thbar/kiba

Data processing & ETL framework for Ruby

1.8K+4–
54hi-primus/optimus

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

1.5K+4–
55PatMartin/Dex

Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.

1.3K+4–
56Cinchoo/ChoETL

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

861+4–
57elastic/elasticsearch-hadoop

:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop

2K+3–
58mongodb/mongo-spark

The MongoDB Spark Connector

729+3–
59pingcap/tiflow

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)

464+3–
60Breeze0806/go-etl

go-etl is a toolset for data extraction, transformation and loading.

192+3–

Faster than the 30 days before

Net stars of the last 30 days are 2 or more times those of the 30 days before.

No repository with this Tag meets this rule now.

Slower than the 30 days before

Net stars of the last 30 days are 50% or less of those of the 30 days before.

  1. pathwaycom/pathway-0.2× · -18
  2. slothflowlabs/duckle0.3× · +75

New in the last 90 days

Created on GitHub in the last 90 days.

  1. hugues31/duckpad+306 · 11 days ago

Older than 2 years, still releasing

Created more than 2 years ago, with a push in the last 7 days and a GitHub release in the last 30 days.

  1. subquery/subql19K · release 7 days ago
  2. Unstructured-IO/unstructured16K · release 6 days ago
  3. elastic/logstash15K · release 2 days ago
  4. dbt-labs/dbt14K · release yesterday
  5. redpanda-data/connect8.8K · release 5 days ago
All 26 in the table

Last release more than 180 days ago

The newest GitHub release is more than 180 days old. A repository that never published a release is not in this list.

  1. airbytehq/airbyte22K · release last year
  2. alibaba/DataX17K · release 3 years ago
  3. pentaho/pentaho-kettle8.4K · release 11 years ago
  4. snowplow/snowplow7K · release 4 years ago
  5. mozilla-services/heka3.4K · release 10 years ago
All 49 in the table

Top GitHub topics with this Tag

Primary languages

How a repository gets this Tag

An agent reads the description, the GitHub topics, and the start of the README of each repository. It chooses Tags only from the Tag list in the AwesomeRepos source code. For each Tag, it quotes the text. A code check keeps the Tag only when the quote is in that text. The page of each repository shows the quote of each of its Tags. A Tag does not rank repositories. It does not say that one repository can replace another. To report a wrong Tag, use "Report a problem with this page" on the page of the repository.

How the numbers are counted

All numbers come from the Star History of the repositories that have the Tag now. A period is a run of complete UTC days. All numbers on this page count only the repositories that AwesomeRepos shows in lists. A machine computes them each hour.

For each repository, a period counts only when Star History has each of its days, or when the repository was created in the period. Otherwise the table shows "–". The bars of a week with no complete data are grey.

The Pace is the net stars of a period divided by the net stars of the period before. It shows only when Star History covers each day of the period before, with at least 3 net stars a day on average.

The chart at the top adds up the net stars of all the repositories with the Tag. A rising Admission comes into the Repository Index because it gained stars quickly. Its Star History before its Admission comes from the Repository Host. Thus the days before many rising Admissions are higher than they were for the repositories in the index at that time.

The releases are the GitHub releases of each repository. The lists and the table do not rank repositories, and they do not say that one repository can replace another.