1.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
Ranked by Attention Score: stars gained over the last 30 complete days
54 repositories by Attention Score · Oct 6, 2026 – Nov 4, 2026 (UTC)
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
All-in-one IoT Platform - Device management, data collection, processing and visualization.
The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles
Eclipse Mosquitto - An open source MQTT broker
Node-based Visual Programming Toolbox
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
Open source RabbitMQ: core server and tier 1 (built-in) plugins
TranslatedDataX is the open-source version of Alibaba Cloud DataWorks Data Integration.
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
lakeFS - Data version control for your data lake | Git for data
Privacy and Security focused Segment-alternative, in Golang and React
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
The Apache Kafka C/C++ library
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
Pentaho Data Integration ( ETL ) a.k.a Kettle
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Migrate to PostgreSQL in a single command!
Redis is an in-memory database that persists on disk. The data model is key-value, but many different kind of values are supported: Strings, Lists, Sets, Sorted Sets, Hashes, Streams, HyperLogLogs, Bitmaps.
Logstash - transport and process your logs, events, or other data
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)
GoDS (Go Data Structures) - Sets, Lists, Stacks, Maps, Trees, Queues, and much more
The Cloud Native Webhooks Gateway
Ncurses based XMPP client
The swiss army knife of healthcare integration.
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
RabbitMQ .NET client for .NET Standard 2.0+ and .NET 4.6.2+
Healthcare data infrastructure for next generation care delivery.
Generic command line non-JVM Apache Kafka producer and consumer
Real-time monitor and web admin for Celery distributed task queue
:bus: Simple and lean service bus implementation for .NET
Maxwell's daemon, a mysql-to-json kafka producer
MongooseIM is Erlang Solutions' robust, scalable and efficient XMPP server, aimed at large installations. Specifically designed for enterprise purposes, it is fault-tolerant and can utilise the resources of multiple clustered machines.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Modular, Production-Ready, Open-Source EHR
A 100% native C# implementation of ZeroMQ for .NET
Confluent Schema Registry for Kafka
Python Stream Processing
Compositional, streaming I/O library for Scala
visual data prep powered by python
Ruby and Rails efficient Kafka processing framework
Python Stream Processing. A Faust fork
Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.
Analyse GTFS Schedule data by importing it into a PostgreSQL database.
Bunny is a popular, easy to use, mature Ruby client for RabbitMQ
Distributed Stream and Batch Processing
Fast and reliable message broker built on top of Kafka.
The database purpose-built for stream processing applications.
Open, audit-grade agentic data quality framework with portable industry packs