1.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
Ranked by Attention Score: stars gained over the last 90 complete days
63 repositories by Attention Score · Aug 6, 2026 – Nov 3, 2026 (UTC)
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
All-in-one IoT Platform - Device management, data collection, processing and visualization.
The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles
Eclipse Mosquitto - An open source MQTT broker
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Node-based Visual Programming Toolbox
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
Open source RabbitMQ: core server and tier 1 (built-in) plugins
TranslatedDataX is the open-source version of Alibaba Cloud DataWorks Data Integration.
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
lakeFS - Data version control for your data lake | Git for data
Logstash - transport and process your logs, events, or other data
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
Migrate to PostgreSQL in a single command!
The Apache Kafka C/C++ library
GoDS (Go Data Structures) - Sets, Lists, Stacks, Maps, Trees, Queues, and much more
Privacy and Security focused Segment-alternative, in Golang and React
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Pentaho Data Integration ( ETL ) a.k.a Kettle
visual data prep powered by python
The Cloud Native Webhooks Gateway
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Real-time monitor and web admin for Celery distributed task queue
Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)
Healthcare data infrastructure for next generation care delivery.
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
Ncurses based XMPP client
The swiss army knife of healthcare integration.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
:bus: Simple and lean service bus implementation for .NET
Generic command line non-JVM Apache Kafka producer and consumer
Modular, Production-Ready, Open-Source EHR
RabbitMQ .NET client for .NET Standard 2.0+ and .NET 4.6.2+
MongooseIM is Erlang Solutions' robust, scalable and efficient XMPP server, aimed at large installations. Specifically designed for enterprise purposes, it is fault-tolerant and can utilise the resources of multiple clustered machines.
Maxwell's daemon, a mysql-to-json kafka producer
A 100% native C# implementation of ZeroMQ for .NET
Confluent Schema Registry for Kafka
Compositional, streaming I/O library for Scala
Python Stream Processing. A Faust fork
An implementation of Actor, Publish-Subscribe, and CSP models in one rather small C++ framework. With performance, quality, and stability proved by years in the production.
Fast and reliable message broker built on top of Kafka.
Python Stream Processing
Ruby and Rails efficient Kafka processing framework
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.
The database purpose-built for stream processing applications.
ENIGMA HALFpipe is a user-friendly software that facilitates reproducible analysis of fMRI data
Bunny is a popular, easy to use, mature Ruby client for RabbitMQ
JSON-RPC 2.0 implementation over WebSockets for Node.js and JavaScript/TypeScript
Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.
REST job server for Apache Spark
Run MapReduce jobs on Hadoop or Amazon Web Services
Crossbar.io - WAMP application router
Distributed Stream and Batch Processing
Event store for Azure Table Storage
A C# implementation of WAMP (The Web Application Messaging Protocol)
Scalable Full History API Solution for Antelope (former EOSIO) based blockchains
Ballerina MQTT Module.