1.cocoindex-io / cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
- ai
- change-data-capture
- data-indexing
- etl
- indexing
- python
- +14 more
Ranked by Attention Score: stars gained over the last 7 complete days
40 repositories by Attention Score · Oct 29, 2026 – Nov 4, 2026 (UTC)
Incremental engine for long horizon agents 🌟 Star if you like it!
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
The data transformation tool the open-source community deserves.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Self-hosted platform to unify wearable health data through one AI-ready API.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
TranslatedDataX is the open-source version of Alibaba Cloud DataWorks Data Integration.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Privacy and Security focused Segment-alternative, in Golang and React
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
Migrate to PostgreSQL in a single command!
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Sync data from one Postgres database to another
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
Pentaho Data Integration ( ETL ) a.k.a Kettle
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Database Subsetting and Relational Data Browsing Tool.
Logstash - transport and process your logs, events, or other data
Fancy stream processing made operationally mundane
Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)
Dex : The Data Explorer -- A data visualization tool written in Java/Groovy/JavaFX capable of powerful ETL and publishing web visualizations.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Healthcare data infrastructure for next generation care delivery.
The leader in Customer Data Infrastructure
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
Open-source IoT Gateway - integrates devices connected to legacy and third-party systems with ThingsBoard IoT Platform using Modbus, CAN bus, BACnet, BLE, OPC-UA, MQTT, ODBC and REST protocols.
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
Python Streaming DataFrames for Kafka
visual data prep powered by python
Import CSV and JSON into PostgreSQL the easy way
The swiss army knife of healthcare integration.
omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)