1.cocoindex-io / cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
- indexing
- python
- +14 more
+201 stars
from 11,624 · score 5.31
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
30 repositories by Attention Score · Oct 6, 2026 – Nov 4, 2026 (UTC)
2.dbt-labs / dbt
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
- dbt-viewpoint
- slack
- pypa
- data-modeling
- business-intelligence
- analytics
- +1 more
+165 stars
from 13,955 · score 5.11
3.Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
- deep-learning
- document-parsing
- machine-learning
- nlp
- ocr
- information-retrieval
- +14 more
+161 stars
from 15,517 · score 5.09
4.dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
- data-loading
- data-warehouse
- +4 more
+126 stars
from 5,929 · score 4.84
5.apache / seatunnel
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- data-integration
- high-performance
- offline
- real-time
- apache
- batch
- +8 more
+106 stars
from 9,678 · score 4.67
6.slothflowlabs / duckle
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
- data-engineering
- data-integration
- data-pipeline
- data-quality
- duckdb
- elt
- +14 more
+75 stars
from 1,475 · score 4.33
+47 stars
from 6,246 · score 3.87
8.apache / camel
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
- camel
- integration
- java
- microservices
- cloud-native
- data-transformation
- +10 more
+37 stars
from 6,353 · score 3.64
9.bruin-data / bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
- analytics
- bigquery
- data-modeling
- data-pipelines
- python
- snowflake
- +5 more
+35 stars
from 1,765 · score 3.58
10.timeplus-io / proton
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
- clickhouse
- kakfa
- sql
- redpanda
- single-binary
- stream-processing
- +10 more
+18 stars
from 2,263 · score 2.94
11.snowplow / snowplow
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
- data-collection
- product-analytics
- +3 more
+16 stars
from 7,032 · score 2.83
12.Wisser / Jailer
Database Subsetting and Relational Data Browsing Tool.
+15 stars
from 3,201 · score 2.77
13.thingsboard / thingsboard-gateway
Open-source IoT Gateway - integrates devices connected to legacy and third-party systems with ThingsBoard IoT Platform using Modbus, CAN bus, BACnet, BLE, OPC-UA, MQTT, ODBC and REST protocols.
+13 stars
from 2,192 · score 2.64
+13 stars
from 394 · score 2.64
15.arkflow-rs / arkflow
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
- flow
- rust
- rust-lang
- stream
- sql
- datafusion
- +14 more
+9 stars
from 1,306 · score 2.30
+7 stars
from 3,364 · score 2.08
17.quixio / quix-streams
Python Streaming DataFrames for Kafka
+7 stars
from 1,575 · score 2.08
18.ConduitIO / conduit
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
- go
- data-integration
- etl
- data-pipeline
- data-engineering
- data-stream
- +3 more
+6 stars
from 611 · score 1.95
19.apache / inlong
Apache InLong - a one-stop, full-scenario integration framework for massive data
- inlong
- one-stop-service
- data-streaming
- event-streaming
- framework
- massive-data-integration
- +1 more
+4 stars
from 1,503 · score 1.61
20.PatMartin / Dex
Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.
- data-science
- data-visualization
- visualization
- data-analysis
- data-mining
- java
- +7 more
+3 stars
from 1,315 · score 1.39
21.aws / aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
- python
- aws
- pandas
- apache-arrow
- apache-parquet
- data-engineering
- +14 more
+2 stars
from 4,120 · score 1.10
22.apache / gobblin
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
- data
- ingestion
- replication
- management
- apache
+2 stars
from 2,268 · score 1.10
23.elastic / elasticsearch-hadoop
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
+2 stars
from 1,965 · score 1.10
+1 stars
from 1,784 · score 0.69
25.hi-primus / optimus
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
- spark
- pyspark
- data-wrangling
- bigdata
- big-data-cleaning
- data-science
- +13 more
+1 stars
from 1,534 · score 0.69
26.mongodb / mongo-spark
The MongoDB Spark Connector
+1 stars
from 728 · score 0.69
27.pingcap / tiflow
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
+1 stars
from 463 · score 0.69
28.neo4j / neo4j-spark-connector
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
- bolt
- hacktoberfest
+1 stars
from 323 · score 0.69
+1 stars
from 213 · score 0.69
30.Breeze0806 / go-etl
go-etl is a toolset for data extraction, transformation and loading.
- etl
- mysql
- go
- postgresql
- greenplum
- csv
- +5 more
+1 stars
from 191 · score 0.69