Trending repositories

1.the-momentum / open-wearables

Self-hosted platform to unify wearable health data through one AI-ready API.

• wearables
• apple-health
• apple-watch
• fitness
• fitness-analysis
• fitness-api
• +9 more

2.bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

• bloom
• deep-learning
• distributed-systems
• language-models
• large-language-models
• machine-learning
• +14 more

3.svix / svix-webhooks

The open source and enterprise-ready webhooks service 🦀

• webhooks
• rust
• webhook-server
• webhook-service
• webhook
• webhooks-server
• +13 more

4.ThreeDotsLabs / watermill

Building event-driven applications the easy way in Go.

• watermill
• event-driven
• event-sourcing
• sagas
• events
• stream-processing
• +7 more

5.Data-Centric-AI-Community / fg-data-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

• pandas-profiling
• pandas-dataframe
• statistics
• jupyter-notebook
• exploration
• data-science
• +14 more

6.onetimesecret / onetimesecret

Keep passwords and other sensitive information out of your chat logs and inboxes.

• privacy
• onetime
• secrets
• chat
• email
• messaging
• +1 more

7.unionai-oss / pandera

A light-weight, flexible, and expressive statistical data testing library

• pandas
• validation
• schema
• dataframes
• testing
• pandas-validation
• +12 more

8.meltano / meltano

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

• dataops
• dataops-platform
• elt
• open-source
• opensource
• data
• +14 more

9.nanomq / nanomq

An ultra-lightweight and blazing-fast Messaging Bus/MQTT Broker for Edge & SDV

• mqtt
• mqtt-broker
• iot-edge
• nng
• aio
• actor-model
• +14 more

10.IBM / sarama

Sarama is a Go library for Apache Kafka.

• kafka
• kafka-client
• go

11.nsqio / nsq

A realtime distributed messaging platform

• go
• messaging
• distributed-systems
• queue
• message-queue
• nsq

12.narwhals-dev / narwhals

Lightweight and extensible compatibility layer between dataframe libraries!

• cudf
• ibis
• pandas
• polars
• pyarrow
• dask
• +2 more

13.mochi-mqtt / server

The fully compliant, embeddable high-performance Go MQTT v5 server for IoT, smarthome, and pubsub

• mqtt
• mqtt-broker
• mqtt-server
• mqtt-smarthome
• golang
• iot
• +7 more

14.dotnetcore / CAP

Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern

• kafka
• rabbitmq
• distributed-transactions
• outbox-pattern
• eventbus
• microservices
• +1 more

15.developit / mitt

🥊 Tiny 200 byte functional event emitter / pubsub.

• mitt
• event-handlers
• pubsub
• tiny
• event
• event-bus
• +2 more

16.BrighterCommand / Brighter

A framework for building messaging apps with .NET and C#.

• command-processor
• command-dispatcher
• brighter
• asynchronously
• nuget-packages
• scale
• +11 more

17.posit-dev / pointblank

Data validation toolkit for assessing and monitoring data quality.

• data-validation
• tabular-data
• data-testing
• data-quality
• easy-to-understand

18.dotnet / reactive

The Reactive Extensions for .NET

19.sfu-db / dataprep

Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.

• dataprep
• data-science
• datapreparation
• dataconnector
• eda
• exploratory-data-analysis
• +7 more

20.laravel / horizon

Dashboard and code-driven configuration for Laravel queues.

• laravel
• queue

21.moscajs / aedes

Barebone MQTT broker that can run on any stream server, the node way

• mqtt
• mqtt-broker
• nodejs
• mqtt-server
• mosquitto
• iot
• +3 more

22.wind-c / comqtt

A lightweight, high-performance go mqtt server(v3.0|v3.1.1|v5.0) supporting distributed cluster

• golang
• mqtt
• iot
• cluster
• distributed
• golang-library
• +9 more

23.go-mysql-org / go-mysql

a powerful mysql toolset with Go

24.ankane / pgsync

Sync data from one Postgres database to another

• postgresql

25.piskvorky / smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

• python
• s3
• hdfs
• webhdfs
• boto
• streaming
• +5 more

26.goptics / varmq

A Simplest in-memory and Distributed Storage-Agnostic Message Queue for Your Concurrent Go Program

• concurrency
• go
• goroutine
• priority-queue
• queue
• worker
• +6 more

27.smrchy / rsmq

Redis Simple Message Queue

• rsmq
• queue
• message-queue
• fifo
• redis
• nodejs
• +1 more

28.pyjanitor-devs / pyjanitor

Clean APIs for data cleaning. Python implementation of R package Janitor

• pandas
• dataframe
• data
• cleaning-data
• data-engineering
• pydata
• +1 more

29.nnnkkk7 / snowflake-emulator

A lightweight Snowflake emulator built with Go and DuckDB for local development and testing

• cicd
• database
• docker
• duckdb
• emulator
• go
• +10 more

30.EasyNetQ / EasyNetQ

An easy to use .NET API for RabbitMQ

• rabbitmq
• messaging
• dotnet
• dotnet-core

31.reugn / go-streams

A lightweight stream processing library for Go

• stream-processing
• pipeline
• etl
• kafka
• data-stream
• kafka-streams
• +14 more

32.pancsta / asyncmachine-go

state machine which runs code

• golang
• workflows
• state-machine
• actor-model
• aop
• consensus
• +14 more

33.datafold / data-diffArchived

Compare tables within or across databases

• database
• mysql
• postgresql
• snowflake
• rdbms
• trino
• +14 more

34.microsoft / GraphEngineArchived

Microsoft Graph Engine

• graph-engine
• graph-query-language
• in-memory-storage
• in-memory-computations
• distributed-computing
• dotnet

35.liyue201 / gostl

Data structure and algorithm library for go, designed to provide functions similar to C++ STL

• list
• vector
• deque
• queue
• stack
• set
• +9 more

36.DrmagicE / gmqtt

Gmqtt is a flexible, high-performance MQTT broker library that fully implements the MQTT protocol V3.x and V5 in golang

• mqtt
• mqtt-broker
• mqtt-protocol
• mqtt-server
• server
• gmqtt
• +1 more

37.gammazero / deque

Fast ring-buffer deque (double-ended queue)

• deque
• queue
• ring-buffer
• circular-buffer
• circular-queue

38.adrianbrad / queue

⏪️ Go package providing multiple queue implementations. Developed in a thread-safe generic way.

• generic
• golang
• queue
• thread-safe
• go
• blocking-queue
• +3 more

39.microsoft / Trill

Trill is a single-node query processor for temporal or streaming data.

• streaming-data
• temporal-data

40.message-db / message-db

Microservice native message and event store for Postgres

• event-store
• event-sourcing
• event-driven
• pub-sub
• event-stream
• message-queue
• +1 more

41.implerhq / impler.io

Powerful CSV & Excel Import experience for SaaS 🚀 Save months building data import experience from scratch 💰

• csv-import
• data-import
• data-mapping
• data-review
• data-validation
• excel-import
• +8 more

42.mikestefanello / backlite

Type-safe, persistent, embedded task queues and background job runner w/ SQLite. Web monitoring UI included.

• go
• golang
• job-queue
• job-scheduler
• jobs
• queue
• +13 more

43.mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

• etl
• data-integration
• python
• postgresql
• pipeline
• data

44.jf-tech / omniparser

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

• transform
• etl
• xml
• json
• csv
• fixed-length
• +13 more

45.litenova / LiteBus

Modular .NET messaging for commands, queries, events, durable inbox and outbox processing, sagas, and broker transports.

• cqrs
• cqs
• csharp
• dotnet-core
• mediator
• eventbus
• +3 more

46.Protocol-Lattice / GoEventBus

GoEventBus — high-performance event bus with a decision layer.

• golang
• library
• event-driven
• concurrency
• event-driven-architecture
• pubsub
• +8 more

47.rbmuller / scherlok

A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.

• anomaly-detection
• bigquery
• cli
• data-engineering
• data-observability
• data-quality
• +14 more

48.chronicle-app / chronicle-etl

📜 A CLI toolkit for extracting and working with your digital history

• chronicle
• chronicle-etl
• personal-data
• etl
• cli
• archiving
• +7 more

49.Cinchoo / ChoETL

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

• csv
• parser
• writer
• reader
• flat
• xml
• +11 more

50.weyoss / redis-smq

RedisSMQ: A high-performance Redis message queue for Node.js

• redis
• background-jobs
• brokers
• dead-letter-queue
• delayed-jobs
• distributed-systems
• +14 more

51.mehdihadeli / Go-MediatR

🚃 A library for handling mediator patterns and simplified CQRS patterns within an event-driven architecture, inspired by csharp MediatR library.

• cqrs
• golang
• mediator
• mediator-pattern
• go
• golang-package

52.brunch / brunch

🍴 Web applications made easy. Since 2011.

• javascript
• workflow
• build-automation
• pipeline
• brunch

53.asaskevich / EventBus

[Go] Lightweight eventbus with async compatibility for Go

• event-driven
• golang

54.gazette / core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

• golang
• event-sourcing
• stream-processing
• brokers
• streaming-platforms

55.LGouellec / streamiz

.NET Stream Processing Library for Apache Kafka 🚀

• kafka-streams-dotnet
• kafka-streams
• kafka-streams-net
• kafka
• event-streaming
• streamiz

56.fieldryand / goflow

Simple but powerful DAG scheduler and dashboard

• directed-acyclic-graph
• airflow
• dashboard
• go
• job-scheduler
• schedule
• +1 more

57.zeromq / lzmq

Lua binding to ZeroMQ

• lua-bindings
• zeromq
• ffi
• messaging
• lua
• zmq

58.flow-php / parquet

PHP ETL - parquet library

59.qvcloud / broker

A production-grade messaging abstraction for Go. It provides a unified API to decouple business logic from various brokers including Kafka, RabbitMQ, RocketMQ, NATS, Redis, and AWS SQS. Featuring built-in OpenTelemetry integration and engineered for high reliability.

• go
• kafka
• message-broker
• opentelemetry
• rabbitmq
• redis
• +5 more

60.cujojs / most

Ultra-high performance reactive programming

61.bottenderjs / messaging-apis

Messaging APIs for multi-platform

• messaging
• messenger
• line
• api-client
• chatbot
• slack
• +4 more

62.pdpipe / pdpipe

Easy pipelines for pandas DataFrames.

• pandas
• pandas-dataframe
• pipeline
• data
• data-science
• dataframe
• +1 more

63.agoodway / walex

Postgres change events (CDC) in Elixir [WAL]

• cdc
• change-data-capture
• elixir
• postgres
• postgresql
• replication
• +1 more

64.helgeho / ArchiveSpark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving
• webarchive
• internet-archive
• +1 more

65.Steema / TeeBI

Data-mining and Visualization components for RAD Studio

• visualization
• complex-structures
• database
• charting-library
• multidimensional-data
• query-engine
• +7 more

66.groda / big_data

Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.

• big-data
• bigdata
• spark
• spark-sql
• docker
• mapreduce
• +13 more

67.joseferben / pocketbase-queue

A type-safe queue for background tasks using PocketBase.

• background-jobs
• pocketbase
• queue
• typescript
• workers

68.wisp-trading / wisp

Wisp CLI — Interactive trading platform for backtesting and live trading across spot, perpetual futures, options, and prediction markets

• algorithmic-trading
• cryptocurrency
• event-driven
• go
• golang
• trading-algorithms
• +2 more

69.godalida / koala-diff

Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.

• csv
• data-engineering
• data-quality
• diff
• high-performance
• parquet
• +4 more

70.lukasmartinelli / pgfutter

Import CSV and JSON into PostgreSQL the easy way

71.jakubkulhan / bunny

Performant pure-PHP AMQP (RabbitMQ) sync/async (ReactPHP) library

• amqp
• amqp-client
• amqp0-9-1
• php
• php-library
• rabbitmq

72.otobus / event_bus

:surfer: Traceable, extendable and minimalist **event bus** implementation for Elixir with built-in **event store** and **event watcher** based on ETS.

• elixir
• eventbus
• event-sourcing
• eventstore
• message-bus
• instrumentation

73.xuri / aurora

Cross-platform beanstalkd queue server admin console.

• aurora
• go
• beanstalkd
• bstk
• console
• admin
• +3 more

74.sizovs / PipelinR

PipelinR is a lightweight command processing pipeline ❍ ⇢ ❍ ⇢ ❍ for your Java awesome app.

• java
• architecture
• service-layer
• pipes-and-filters
• mediator
• mediatr
• +5 more

75.larpon / QtFirebase

An effort to bring Google's Firebase C++ API to Qt + QML

• qt
• firebase
• qml
• plugin
• qtfirebase
• admob
• +9 more

76.BEagle1984 / silverback

Silverback is a message bus and broker integration library for .NET. It is designed to simplify event-driven architectures and asynchronous messaging, with first-class support for Apache Kafka and MQTT.

• microservice
• messaging
• kafka
• silverback
• message-bus
• message-brokers
• +6 more

77.cswank / kcli

A kafka command line browser

• kafka
• cli
• browser

78.synacker / daggy

Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching

• serverless-framework
• streaming
• stream-processing
• qt
• aggregation
• process
• +7 more

79.spreedly / kaffe

An opinionated Elixir wrapper around brod, the Erlang Kafka client, that supports encrypted connections to Heroku Kafka out of the box.

• elixir
• kafka

80.capillariesio / capillaries

Distributed batch data processing framework

• cassandra
• rabbitmq
• go
• batch-processing
• dag
• distributed-computing
• +5 more

81.leozz37 / hare

🐇 CLI tool for websockets and Go package

• sockets
• golang
• go
• network
• socketio
• messaging
• +1 more

82.etlkit / etlkit

EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.

• dotnet
• dotnet-core
• etl
• etl-framework

83.princemaple / elixir-queue

Queue data structure for Elixir-lang

• hex
• elixir
• queue
• data-structure
• wrapper

84.biot2 / nats.pas

An Object Pascal Client for NATS

• delphi
• lazarus
• pascal
• linux
• fpc
• nats
• +3 more

85.vinod-morya / fibersse

Production-grade Server-Sent Events (SSE) for Fiber v3. Event coalescing, priority lanes, topic wildcards, adaptive throttling, built-in auth, Prometheus metrics, graceful drain.

• event-streaming
• fasthttp
• fiber
• gofiber
• golang
• pub-sub
• +4 more