1.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
Ranked by Attention Score: stars gained over the last 30 complete days
55 repositories by Attention Score · Oct 5, 2026 – Nov 3, 2026 (UTC)
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
All-in-one IoT Platform - Device management, data collection, processing and visualization.
The most scalable and reliable MQTT broker for AI, IoT, IIoT and connected vehicles
Eclipse Mosquitto - An open source MQTT broker
Node-based Visual Programming Toolbox
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
Open source RabbitMQ: core server and tier 1 (built-in) plugins
TranslatedDataX is the open-source version of Alibaba Cloud DataWorks Data Integration.
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
lakeFS - Data version control for your data lake | Git for data
Privacy and Security focused Segment-alternative, in Golang and React
The Apache Kafka C/C++ library
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
Pentaho Data Integration ( ETL ) a.k.a Kettle
Migrate to PostgreSQL in a single command!
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Logstash - transport and process your logs, events, or other data
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
GoDS (Go Data Structures) - Sets, Lists, Stacks, Maps, Trees, Queues, and much more
The Cloud Native Webhooks Gateway
Ncurses based XMPP client
pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
Maxwell's daemon, a mysql-to-json kafka producer
RabbitMQ .NET client for .NET Standard 2.0+ and .NET 4.6.2+
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
Real-time monitor and web admin for Celery distributed task queue
:bus: Simple and lean service bus implementation for .NET
Generic command line non-JVM Apache Kafka producer and consumer
MongooseIM is Erlang Solutions' robust, scalable and efficient XMPP server, aimed at large installations. Specifically designed for enterprise purposes, it is fault-tolerant and can utilise the resources of multiple clustered machines.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Modular, Production-Ready, Open-Source EHR
A 100% native C# implementation of ZeroMQ for .NET
Confluent Schema Registry for Kafka
Logical Replication extension for PostgreSQL 17, 16, 15, 14, 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.
Python Stream Processing
Compositional, streaming I/O library for Scala
Ruby and Rails efficient Kafka processing framework
Python Stream Processing. A Faust fork
visual data prep powered by python
Fast and reliable message broker built on top of Kafka.
JVM Profiler Sending Metrics to Kafka, Console Output or Custom Reporter
Job processing library for Elixir - compatible with Resque / Sidekiq
Bunny is a popular, easy to use, mature Ruby client for RabbitMQ
Jupyter magics and kernels for working with remote Spark clusters
A lightweight framework to help creating CQRS and Eventsourcing applications in C#
Distributed Stream and Batch Processing
Chat SDK iOS - Open Source Mobile Messenger
An implementation of Actor, Publish-Subscribe, and CSP models in one rather small C++ framework. With performance, quality, and stability proved by years in the production.
The database purpose-built for stream processing applications.
Ballerina MQTT Module.