Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–24 of 39 · Most stars
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
- change-data-capture
- kafka-connect
- apache-kafka
- debezium
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
Seamless multi-primary syncing database with an intuitive HTTP/JSON API, designed for reliability
the portable Python dataframe library
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
KurrentDB is a database that's engineered for modern software applications and event-driven architectures. Its event-native design simplifies data modeling and preserves data integrity while the integrated streaming engine solves distributed messaging challenges and ensures data consistency.
- cqrs
- eventsourcing
- eventstore
- event-sourcing
Apache Ignite
- distributed-sql-database
- iot
- osgi
- network-client
Where data access meets operational intelligence
- mysql
- postgresql
- ai-agent
- data-catalog
Self-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.
- cron
- workflow-engine
- workflow-scheduler
- workflow-orchestration
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
- bigquery
- copy-database
- data-ingestion
- data-integration
.NET Transactional Document DB and Event Store on PostgreSQL
- marten
- postgres
- documentdb
- eventsourcing
A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)
- database
- graph-database
- graph
- gremlin
KubeBlocks is a Kubernetes Operator designed to manage a variety of databases and streaming systems, including MySQL, PostgreSQL, MongoDB, Redis, RabbitMQ, RocketMQ, and more, within Kubernetes environments.
- mysql-operator
- mongodb-operator
- postgresql-operator
- rabbitmq-operator
GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.
Object-storage native graph database with branching and typed ontology
- apache-arrow
- datafusion
- graph-database
- knowledge-graph
Distributed Prometheus time series database
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
- database
- data-analysis
- data-warehouse
- olap
Logical Replication extension for PostgreSQL 17, 16, 15, 14, 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.
- postgresql
- replication
- logical-decoding
- database-replication
Event store using PostgreSQL for persistence
- cqrs
- eventstore
- elixir
- event-sourcing
Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster
zerocode-tdd is a community-developed, free, open-source, outcome-driven automated testing framework for Data Pipelines, ETL, REST API, Kafka(Data Streams), Databases and Load scenarios. all defined in simple JSON or YAML — with zero coding.
- soap
- assertions
- java
- api