Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–24 of 24 · Most stars
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
- change-data-capture
- kafka-connect
- apache-kafka
- debezium
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Migrate to PostgreSQL in a single command!
- postgresql
- migration
- mysql
- mssql
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Apache Ignite
- distributed-sql-database
- iot
- osgi
- network-client
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
- bigquery
- copy-database
- data-ingestion
- data-integration
Sync data from one Postgres database to another
Database Subsetting and Relational Data Browsing Tool.
Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)
Polo travels through your database and creates sample snapshots so you can work with real world data in development.
- database
- snapshot
- productivity
- activerecord
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
Amazon Redshift Database Loader implemented in AWS Lambda
🌱 The ultimate solution for populating your MongoDB database.
MySQL to PostgreSQL replica system
- python
- postgresql
- mysql
- mysql-replication
The database purpose-built for stream processing applications.
- stream-processing
- real-time
- sql
- interactive
An effort to bring Google's Firebase C++ API to Qt + QML
BENERATOR is a leading software solution to generate, obfuscate, pseudonymize and migrate data for development, testing, and training purposes with a model-driven approach.
- testdata
- anonymization
- migration
- performance-testing
Data-mining and Visualization components for RAD Studio
- visualization
- complex-structures
- database
- charting-library
Time-series database and pub/sub messaging server for IoT and real-time devices, in Go: an embeddable storage engine with TTLs, wildcard topics and encryption, and a clustered server over gRPC, TCP and WebSocket with replication and rolling upgrades.
A library that brings useful functions from various modern database management systems to Apache Spark
Stream database events from PostgreSQL to Kafka
- postgresql
- events
- stream
- kafka
A lightweight Snowflake emulator built with Go and DuckDB for local development and testing