1.cocoindex-io / cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
- indexing
- python
- +14 more
+3,004 stars
from 8,814 · score 8.01
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
43 repositories by Attention Score · May 8, 2026 – Nov 3, 2026 (UTC)
2.dbt-labs / dbt
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
- dbt-viewpoint
- slack
- pypa
- data-modeling
- business-intelligence
- analytics
- +1 more
+1,470 stars
from 12,646 · score 7.29
3.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
+1,223 stars
from 21,089 · score 7.11
4.the-momentum / open-wearables
Self-hosted platform to unify wearable health data through one AI-ready API.
- wearables
- apple-health
- apple-watch
- fitness
- fitness-analysis
- fitness-api
- +9 more
+1,174 stars
from 1,579 · score 7.07
5.Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
- deep-learning
- document-parsing
- machine-learning
- nlp
- ocr
- information-retrieval
- +14 more
+1,116 stars
from 14,561 · score 7.02
6.pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
+844 stars
from 61,177 · score 6.74
7.dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
- data-loading
- data-warehouse
- +4 more
+784 stars
from 5,267 · score 6.67
8.bruin-data / ingestr
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
- bigquery
- copy-database
- data-ingestion
- data-integration
- data-pipeline
- duckdb
- +4 more
+596 stars
from 3,443 · score 6.39
9.apache / seatunnel
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
- apache
- batch
- +8 more
+534 stars
from 9,251 · score 6.28
10.alibaba / DataX
TranslatedDataX is the open-source version of Alibaba Cloud DataWorks Data Integration.
+287 stars
from 17,091 · score 5.66
+245 stars
from 6,046 · score 5.51
12.PeerDB-io / peerdb
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
- etl
- sql
- bigquery
- cloud-native
- distributed-systems
- kafka
- +10 more
+237 stars
from 3,076 · score 5.47
13.bruin-data / bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
- analytics
- bigquery
- data-modeling
- data-pipelines
- python
- snowflake
- +5 more
+233 stars
from 1,566 · score 5.46
14.apache / camel
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
- camel
- integration
- java
- microservices
- cloud-native
- data-transformation
- +10 more
+225 stars
from 6,165 · score 5.42
15.meltano / meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
- dataops
- dataops-platform
- elt
- open-source
- opensource
- data
- +14 more
+208 stars
from 2,467 · score 5.34
16.dathere / qsv
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
- csv
- data-wrangling
- opendata
- data-engineering
- ckan
- excel
- +14 more
+204 stars
from 3,614 · score 5.32
17.elastic / logstash
Logstash - transport and process your logs, events, or other data
+187 stars
from 14,784 · score 5.24
18.dimitri / pgloader
Migrate to PostgreSQL in a single command!
- postgresql
- migration
- mysql
- mssql
- sqlite
- common-lisp
- +7 more
+176 stars
from 6,379 · score 5.18
19.cloudquery / cloudquery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
+174 stars
from 6,375 · score 5.16
20.redpanda-data / connect
Fancy stream processing made operationally mundane
- message-queue
- stream-processing
- streaming-data
- message-bus
- logs
- stream-processor
- +11 more
+166 stars
from 8,627 · score 5.12
21.rudderlabs / rudder-server
Privacy and Security focused Segment-alternative, in Golang and React
- privacy
- warehouse-management
- data-warehouse
- customer-data
- customer-data-pipeline
- customer-data-platform
- +14 more
+135 stars
from 4,380 · score 4.91
22.pentaho / pentaho-kettle
Pentaho Data Integration ( ETL ) a.k.a Kettle
+119 stars
from 8,293 · score 4.79
23.timeplus-io / proton
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
- clickhouse
- kakfa
- sql
- redpanda
- single-binary
- stream-processing
- +10 more
+100 stars
from 2,181 · score 4.62
24.dimitri / pgcopydb
Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)
+100 stars
from 1,479 · score 4.62
25.thingsboard / thingsboard-gateway
Open-source IoT Gateway - integrates devices connected to legacy and third-party systems with ThingsBoard IoT Platform using Modbus, CAN bus, BACnet, BLE, OPC-UA, MQTT, ODBC and REST protocols.
+99 stars
from 2,106 · score 4.61
26.Wisser / Jailer
Database Subsetting and Relational Data Browsing Tool.
+77 stars
from 3,139 · score 4.36
27.snowplow / snowplow
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
- data-collection
- product-analytics
- +3 more
+60 stars
from 6,988 · score 4.11
28.Multiwoven / multiwoven
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
- data-engineering
- reverse-etl
- data-pipeline
- data-activation
- etl
- react
- +14 more
+49 stars
from 1,635 · score 3.91
29.sfu-db / dataprep
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
- dataprep
- data-science
- datapreparation
- dataconnector
- eda
- exploratory-data-analysis
- +7 more
+43 stars
from 2,227 · score 3.78
30.quixio / quix-streams
Python Streaming DataFrames for Kafka
+42 stars
from 1,540 · score 3.76
+37 stars
from 3,334 · score 3.64
32.ankane / pgsync
Sync data from one Postgres database to another
+35 stars
from 3,445 · score 3.58
33.aws / aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
- python
- aws
- pandas
- apache-arrow
- apache-parquet
- data-engineering
- +14 more
+32 stars
from 4,090 · score 3.50
34.apache / inlong
Apache InLong - a one-stop, full-scenario integration framework for massive data
- inlong
- one-stop-service
- data-streaming
- event-streaming
- framework
- massive-data-integration
- +1 more
+25 stars
from 1,482 · score 3.26
35.subquery / subql
SubQuery is an Open, Flexible, Fast and Universal data indexing framework for web3. Our mission is to help developers create the decentralised products of the future.
+23 stars
from 18,700 · score 3.18
36.apache / gobblin
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
- data
- ingestion
- replication
- management
- apache
+16 stars
from 2,254 · score 2.83
37.mara / mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
- etl
- data-integration
- python
- postgresql
- pipeline
- data
+13 stars
from 2,078 · score 2.64
38.apache / cassandra-spark-connector
Apache Spark to Apache Cassandra connector
+12 stars
from 1,943 · score 2.56
+7 stars
from 1,769 · score 2.08
+6 stars
from 1,779 · score 1.95
41.elastic / elasticsearch-hadoop
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
+5 stars
from 1,962 · score 1.79
42.pinterest / secorArchived
Secor is a service implementing Kafka log persistence
+4 stars
from 1,854 · score 1.61
+1 stars
from 1,546 · score 0.69