Trending repositories

1.the-momentum / open-wearables

Self-hosted platform to unify wearable health data through one AI-ready API.

• wearables
• apple-health
• apple-watch
• fitness
• fitness-analysis
• fitness-api
• +9 more

2.bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

• bloom
• deep-learning
• distributed-systems
• language-models
• large-language-models
• machine-learning
• +14 more

3.ThreeDotsLabs / watermill

Building event-driven applications the easy way in Go.

• watermill
• event-driven
• event-sourcing
• sagas
• events
• stream-processing
• +7 more

4.svix / svix-webhooks

The open source and enterprise-ready webhooks service 🦀

• webhooks
• rust
• webhook-server
• webhook-service
• webhook
• webhooks-server
• +13 more

5.Data-Centric-AI-Community / fg-data-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

• pandas-profiling
• pandas-dataframe
• statistics
• jupyter-notebook
• exploration
• data-science
• +14 more

6.onetimesecret / onetimesecret

Keep passwords and other sensitive information out of your chat logs and inboxes.

• privacy
• onetime
• secrets
• chat
• email
• messaging
• +1 more

7.meltano / meltano

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

• dataops
• dataops-platform
• elt
• open-source
• opensource
• data
• +14 more

8.unionai-oss / pandera

A light-weight, flexible, and expressive statistical data testing library

• pandas
• validation
• schema
• dataframes
• testing
• pandas-validation
• +12 more

9.nanomq / nanomq

An ultra-lightweight and blazing-fast Messaging Bus/MQTT Broker for Edge & SDV

• mqtt
• mqtt-broker
• iot-edge
• nng
• aio
• actor-model
• +14 more

10.nsqio / nsq

A realtime distributed messaging platform

• go
• messaging
• distributed-systems
• queue
• message-queue
• nsq

11.narwhals-dev / narwhals

Lightweight and extensible compatibility layer between dataframe libraries!

• cudf
• ibis
• pandas
• polars
• pyarrow
• dask
• +2 more

12.IBM / sarama

Sarama is a Go library for Apache Kafka.

• kafka
• kafka-client
• go

13.mochi-mqtt / server

The fully compliant, embeddable high-performance Go MQTT v5 server for IoT, smarthome, and pubsub

• mqtt
• mqtt-broker
• mqtt-server
• mqtt-smarthome
• golang
• iot
• +7 more

14.developit / mitt

🥊 Tiny 200 byte functional event emitter / pubsub.

• mitt
• event-handlers
• pubsub
• tiny
• event
• event-bus
• +2 more

15.dotnet / reactive

The Reactive Extensions for .NET

16.BrighterCommand / Brighter

A framework for building messaging apps with .NET and C#.

• command-processor
• command-dispatcher
• brighter
• asynchronously
• nuget-packages
• scale
• +11 more

17.dotnetcore / CAP

Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern

• kafka
• rabbitmq
• distributed-transactions
• outbox-pattern
• eventbus
• microservices
• +1 more

18.posit-dev / pointblank

Data validation toolkit for assessing and monitoring data quality.

• data-validation
• tabular-data
• data-testing
• data-quality
• easy-to-understand

19.laravel / horizon

Dashboard and code-driven configuration for Laravel queues.

• laravel
• queue

20.go-mysql-org / go-mysql

a powerful mysql toolset with Go

21.d8a-tech / d8a

🇪🇺 Warehouse-native Analytics compatible with Google Analytics and Matomo tracking protocols. Ingest into ClickHouse, BigQuery or CSV/Parquet on S3/GCS/local fs while maintaining complete control over your data.

• clickhouse
• ga4
• tracker
• bigquery
• data-warehouse
• matomo

22.wind-c / comqtt

A lightweight, high-performance go mqtt server(v3.0|v3.1.1|v5.0) supporting distributed cluster

• golang
• mqtt
• iot
• cluster
• distributed
• golang-library
• +9 more

23.sfu-db / dataprep

Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.

• dataprep
• data-science
• datapreparation
• dataconnector
• eda
• exploratory-data-analysis
• +7 more

24.moscajs / aedes

Barebone MQTT broker that can run on any stream server, the node way

• mqtt
• mqtt-broker
• nodejs
• mqtt-server
• mosquitto
• iot
• +3 more

25.ankane / pgsync

Sync data from one Postgres database to another

• postgresql

26.dreamlit-ai / lovable-cloud-to-supabase-exporter

Export your database from Lovable Cloud to Supabase

27.piskvorky / smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

• python
• s3
• hdfs
• webhdfs
• boto
• streaming
• +5 more

28.adrianbrad / queue

⏪️ Go package providing multiple queue implementations. Developed in a thread-safe generic way.

• generic
• golang
• queue
• thread-safe
• go
• blocking-queue
• +3 more

29.pyjanitor-devs / pyjanitor

Clean APIs for data cleaning. Python implementation of R package Janitor

• pandas
• dataframe
• data
• cleaning-data
• data-engineering
• pydata
• +1 more

30.gammazero / deque

Fast ring-buffer deque (double-ended queue)

• deque
• queue
• ring-buffer
• circular-buffer
• circular-queue

31.EasyNetQ / EasyNetQ

An easy to use .NET API for RabbitMQ

• rabbitmq
• messaging
• dotnet
• dotnet-core

32.microsoft / GraphEngineArchived

Microsoft Graph Engine

• graph-engine
• graph-query-language
• in-memory-storage
• in-memory-computations
• distributed-computing
• dotnet

33.asaskevich / EventBus

[Go] Lightweight eventbus with async compatibility for Go

• event-driven
• golang

34.datafold / data-diffArchived

Compare tables within or across databases

• database
• mysql
• postgresql
• snowflake
• rdbms
• trino
• +14 more

35.reugn / go-streams

A lightweight stream processing library for Go

• stream-processing
• pipeline
• etl
• kafka
• data-stream
• kafka-streams
• +14 more

36.litenova / LiteBus

Modular .NET messaging for commands, queries, events, durable inbox and outbox processing, sagas, and broker transports.

• cqrs
• cqs
• csharp
• dotnet-core
• mediator
• eventbus
• +3 more

37.DrmagicE / gmqtt

Gmqtt is a flexible, high-performance MQTT broker library that fully implements the MQTT protocol V3.x and V5 in golang

• mqtt
• mqtt-broker
• mqtt-protocol
• mqtt-server
• server
• gmqtt
• +1 more

38.liyue201 / gostl

Data structure and algorithm library for go, designed to provide functions similar to C++ STL

• list
• vector
• deque
• queue
• stack
• set
• +9 more

39.smrchy / rsmq

Redis Simple Message Queue

• rsmq
• queue
• message-queue
• fifo
• redis
• nodejs
• +1 more

40.implerhq / impler.io

Powerful CSV & Excel Import experience for SaaS 🚀 Save months building data import experience from scratch 💰

• csv-import
• data-import
• data-mapping
• data-review
• data-validation
• excel-import
• +8 more

41.mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

• etl
• data-integration
• python
• postgresql
• pipeline
• data

42.jf-tech / omniparser

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

• transform
• etl
• xml
• json
• csv
• fixed-length
• +13 more

43.LGouellec / streamiz

.NET Stream Processing Library for Apache Kafka 🚀

• kafka-streams-dotnet
• kafka-streams
• kafka-streams-net
• kafka
• event-streaming
• streamiz

44.Protocol-Lattice / GoEventBus

GoEventBus — high-performance event bus with a decision layer.

• golang
• library
• event-driven
• concurrency
• event-driven-architecture
• pubsub
• +8 more

45.microsoft / Trill

Trill is a single-node query processor for temporal or streaming data.

• streaming-data
• temporal-data

46.gazette / core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

• golang
• event-sourcing
• stream-processing
• brokers
• streaming-platforms

47.Cinchoo / ChoETL

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

• csv
• parser
• writer
• reader
• flat
• xml
• +11 more

48.weyoss / redis-smq

RedisSMQ: A high-performance Redis message queue for Node.js

• redis
• background-jobs
• brokers
• dead-letter-queue
• delayed-jobs
• distributed-systems
• +14 more

49.agoodway / walex

Postgres change events (CDC) in Elixir [WAL]

• cdc
• change-data-capture
• elixir
• postgres
• postgresql
• replication
• +1 more

50.bottenderjs / messaging-apis

Messaging APIs for multi-platform

• messaging
• messenger
• line
• api-client
• chatbot
• slack
• +4 more

51.message-db / message-db

Microservice native message and event store for Postgres

• event-store
• event-sourcing
• event-driven
• pub-sub
• event-stream
• message-queue
• +1 more

52.brunch / brunch

🍴 Web applications made easy. Since 2011.

• javascript
• workflow
• build-automation
• pipeline
• brunch

53.pdpipe / pdpipe

Easy pipelines for pandas DataFrames.

• pandas
• pandas-dataframe
• pipeline
• data
• data-science
• dataframe
• +1 more

54.sizovs / PipelinR

PipelinR is a lightweight command processing pipeline ❍ ⇢ ❍ ⇢ ❍ for your Java awesome app.

• java
• architecture
• service-layer
• pipes-and-filters
• mediator
• mediatr
• +5 more

55.fieldryand / goflow

Simple but powerful DAG scheduler and dashboard

• directed-acyclic-graph
• airflow
• dashboard
• go
• job-scheduler
• schedule
• +1 more

56.mehdihadeli / Go-MediatR

🚃 A library for handling mediator patterns and simplified CQRS patterns within an event-driven architecture, inspired by csharp MediatR library.

• cqrs
• golang
• mediator
• mediator-pattern
• go
• golang-package

57.chronicle-app / chronicle-etl

📜 A CLI toolkit for extracting and working with your digital history

• chronicle
• chronicle-etl
• personal-data
• etl
• cli
• archiving
• +7 more

58.jakubkulhan / bunny

Performant pure-PHP AMQP (RabbitMQ) sync/async (ReactPHP) library

• amqp
• amqp-client
• amqp0-9-1
• php
• php-library
• rabbitmq

59.helgeho / ArchiveSpark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving
• webarchive
• internet-archive
• +1 more

60.jellesiderius / mage-db-sync

Database synchronizer for Magento 2 (and Wordpress), based on Magerun2. Keeping development, staging and production in sync easily.

• magento2
• magento
• magerun2
• import
• synchronization
• development-environment
• +2 more

61.etlkit / etlkit

EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.

• dotnet
• dotnet-core
• etl
• etl-framework

62.wisp-trading / wisp

Wisp CLI — Interactive trading platform for backtesting and live trading across spot, perpetual futures, options, and prediction markets

• algorithmic-trading
• cryptocurrency
• event-driven
• go
• golang
• trading-algorithms
• +2 more

63.cujojs / most

Ultra-high performance reactive programming

64.BEagle1984 / silverback

Silverback is a message bus and broker integration library for .NET. It is designed to simplify event-driven architectures and asynchronous messaging, with first-class support for Apache Kafka and MQTT.

• microservice
• messaging
• kafka
• silverback
• message-bus
• message-brokers
• +6 more

65.synacker / daggy

Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching

• serverless-framework
• streaming
• stream-processing
• qt
• aggregation
• process
• +7 more

66.capillariesio / capillaries

Distributed batch data processing framework

• cassandra
• rabbitmq
• go
• batch-processing
• dag
• distributed-computing
• +5 more

67.godalida / koala-diff

Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.

• csv
• data-engineering
• data-quality
• diff
• high-performance
• parquet
• +4 more

68.ixian-platform / QuIXI

Quick integration toolkit for Ixian. Connects apps, IoT devices, AI Agents, and services to the Ixian Platform via REST APIs and message queues (MQTT/RabbitMQ). Provides developers with a simple bridge into secure Ixian communication and Client Discovery.

• api
• encryption
• integration
• iot
• message-queue
• messaging
• +14 more

69.zalando / nakadiArchived

A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues

• java
• apis
• event-bus
• restful
• microservices
• postgresql
• +3 more

70.fulminate-io / machine

Machine is a workflow/pipeline library for processing data

• golang
• golang-library
• golang-package
• workflow
• workflow-engine
• pipeline
• +7 more

71.vertti / daffy

Lightweight DataFrame validation decorators for Pandas, Polars, Modin, and PyArrow. No custom types required.

• pandas
• dataframe
• validation
• polars
• pydantic
• data-quality
• +10 more

72.biot2 / nats.pas

An Object Pascal Client for NATS

• delphi
• lazarus
• pascal
• linux
• fpc
• nats
• +3 more

73.j-easy / easy-batch

The simple, stupid batch framework for Java

• java
• batch-processing
• batch