1.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
Ranked by Attention Score: stars gained over the last 90 complete days
60 repositories by Attention Score · Aug 7, 2026 – Nov 4, 2026 (UTC)
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
All-in-one IoT Platform - Device management, data collection, processing and visualization.
The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles
Eclipse Mosquitto - An open source MQTT broker
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Node-based Visual Programming Toolbox
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
Open source RabbitMQ: core server and tier 1 (built-in) plugins
TranslatedDataX is the open-source version of Alibaba Cloud DataWorks Data Integration.
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
lakeFS - Data version control for your data lake | Git for data
Logstash - transport and process your logs, events, or other data
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
Migrate to PostgreSQL in a single command!
The Apache Kafka C/C++ library
GoDS (Go Data Structures) - Sets, Lists, Stacks, Maps, Trees, Queues, and much more
Privacy and Security focused Segment-alternative, in Golang and React
Pentaho Data Integration ( ETL ) a.k.a Kettle
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
visual data prep powered by python
The Cloud Native Webhooks Gateway
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Real-time monitor and web admin for Celery distributed task queue
Healthcare data infrastructure for next generation care delivery.
Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
Ncurses based XMPP client
The swiss army knife of healthcare integration.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
:bus: Simple and lean service bus implementation for .NET
Generic command line non-JVM Apache Kafka producer and consumer
Modular, Production-Ready, Open-Source EHR
RabbitMQ .NET client for .NET Standard 2.0+ and .NET 4.6.2+
Maxwell's daemon, a mysql-to-json kafka producer
MongooseIM is Erlang Solutions' robust, scalable and efficient XMPP server, aimed at large installations. Specifically designed for enterprise purposes, it is fault-tolerant and can utilise the resources of multiple clustered machines.
A 100% native C# implementation of ZeroMQ for .NET
Confluent Schema Registry for Kafka
Compositional, streaming I/O library for Scala
Python Stream Processing. A Faust fork
Fast and reliable message broker built on top of Kafka.
Python Stream Processing
Ruby and Rails efficient Kafka processing framework
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
The database purpose-built for stream processing applications.
A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.
ENIGMA HALFpipe is a user-friendly software that facilitates reproducible analysis of fMRI data
Bunny is a popular, easy to use, mature Ruby client for RabbitMQ
Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.
REST job server for Apache Spark
Crossbar.io - WAMP application router
Distributed Stream and Batch Processing
Scalable Full History API Solution for Antelope (former EOSIO) based blockchains
Ballerina MQTT Module.
Open, audit-grade agentic data quality framework with portable industry packs