Trending repositories

1.ModernRelay / omnigraph

Object-storage native graph database with branching and typed ontology

• apache-arrow
• datafusion
• graph-database
• knowledge-graph
• lakehouse
• lance
• +5 more

2.bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

• bloom
• deep-learning
• distributed-systems
• language-models
• large-language-models
• machine-learning
• +14 more

3.svix / svix-webhooks

The open source and enterprise-ready webhooks service 🦀

• webhooks
• rust
• webhook-server
• webhook-service
• webhook
• webhooks-server
• +13 more

4.ThreeDotsLabs / watermill

Building event-driven applications the easy way in Go.

• watermill
• event-driven
• event-sourcing
• sagas
• events
• stream-processing
• +7 more

5.Data-Centric-AI-Community / fg-data-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

• pandas-profiling
• pandas-dataframe
• statistics
• jupyter-notebook
• exploration
• data-science
• +14 more

6.onetimesecret / onetimesecret

Keep passwords and other sensitive information out of your chat logs and inboxes.

• privacy
• onetime
• secrets
• chat
• email
• messaging
• +1 more

7.unionai-oss / pandera

A light-weight, flexible, and expressive statistical data testing library

• pandas
• validation
• schema
• dataframes
• testing
• pandas-validation
• +12 more

8.meltano / meltano

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

• dataops
• dataops-platform
• elt
• open-source
• opensource
• data
• +14 more

9.nanomq / nanomq

An ultra-lightweight and blazing-fast Messaging Bus/MQTT Broker for Edge & SDV

• mqtt
• mqtt-broker
• iot-edge
• nng
• aio
• actor-model
• +14 more

10.graphile / worker

High performance Node.js/PostgreSQL job queue (also suitable for getting jobs generated by PostgreSQL triggers/functions out into a different work queue)

• postgresql
• node
• worker
• job-queue
• graphile
• nodejs
• +2 more

11.containrrr / shoutrrr

Notification library for gophers and their furry friends.

• notifications
• golang
• go
• messaging
• integrations
• hacktoberfest

12.IBM / sarama

Sarama is a Go library for Apache Kafka.

• kafka
• kafka-client
• go

13.nsqio / nsq

A realtime distributed messaging platform

• go
• messaging
• distributed-systems
• queue
• message-queue
• nsq

14.narwhals-dev / narwhals

Lightweight and extensible compatibility layer between dataframe libraries!

• cudf
• ibis
• pandas
• polars
• pyarrow
• dask
• +2 more

15.destel / rill

Composable concurrency toolkit for Go

• concurrency
• channels
• go
• golang
• pipeline

16.dotnetcore / CAP

Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern

• kafka
• rabbitmq
• distributed-transactions
• outbox-pattern
• eventbus
• microservices
• +1 more

17.JasperFx / marten

.NET Transactional Document DB and Event Store on PostgreSQL

• marten
• postgres
• documentdb
• eventsourcing
• event-sourcing
• document-database
• +2 more

18.developit / mitt

🥊 Tiny 200 byte functional event emitter / pubsub.

• mitt
• event-handlers
• pubsub
• tiny
• event
• event-bus
• +2 more

19.BrighterCommand / Brighter

A framework for building messaging apps with .NET and C#.

• command-processor
• command-dispatcher
• brighter
• asynchronously
• nuget-packages
• scale
• +11 more

20.ChunelFeng / CGraph

Translated【A common used C++ & Python DAG framework】 A general-purpose, third-party-dependency-free, cross-platform parallel computing framework based on flow graphs, listed in awesome-cpp. Welcome to star & fork & discuss

• dag
• workflow
• taskflow
• pipeline
• graph
• ai
• +2 more

21.max0x7ba / atomic_queue

C++14 concurrent lock-free low-latency queue.

• lock-free
• lockfree
• atomics
• queue
• multithreading
• low-latency
• +14 more

22.dotnet / reactive

The Reactive Extensions for .NET

23.ekazaev / ChatLayout

ChatLayout is an alternative solution to MessageKit. It uses custom UICollectionViewLayout to provide you full control over the presentation as well as all the tools available in UICollectionView. It supports dynamic cells and supplementary view sizes.

• chat
• chat-application
• messaging
• messenger
• uicollectionviewlayout
• collectionview
• +7 more

24.laravel / horizon

Dashboard and code-driven configuration for Laravel queues.

• laravel
• queue

25.Tochemey / goakt

[Go]Distributed Actor/Grain framework for Golang with goodies

• actor-model
• actors
• actorsystem
• golang
• golang-library
• distributed-systems
• +13 more

26.boazsegev / facil.io

Your high performance web application C framework

• websocket-server
• http-protocol
• http-parser
• c
• concurrency
• framework
• +7 more

27.bitloops / ddd-hexagonal-cqrs-es-eda

Complete working example of using Domain Driven Design (DDD), Hexagonal Architecture, CQRS, Event Sourcing (ES), Event Driven Architecture (EDA), Behaviour Driven Development (BDD) using TypeScript and NestJS. Like what you see? Don't forget to star! ⭐ ^^^

• bdd
• cqrs
• ddd
• domain-driven-design
• event-sourcing
• hexagonal-architecture
• +9 more

28.boazsegev / iodine

iodine - HTTP / WebSockets Server for Ruby with Pub/Sub support

• ruby
• server
• pubsub
• sse
• clustering
• high-performance
• +5 more

29.pydoit / doit

CLI task management & automation tool

• python
• build-tool
• build-automation
• task-runner
• build-system
• workflow-management
• +6 more

30.phongnguyend / Practical.CleanArchitecture

Full-stack .Net 10 Clean Architecture (Microservices, Modular Monolith, Monolith), Blazor, Angular 22, React 19, Vue 3.5, BFF with YARP, NextJs 16, Domain-Driven Design, CQRS, SOLID, Asp.Net Core Identity Custom Storage, OpenID Connect, EF Core, OpenTelemetry, SignalR, Background Services, Health Checks, Rate Limiting, Clouds (Azure, AWS, GCP), ...

• cqrs
• domain-driven-design
• clean-architecture
• oauth2
• signalr
• docker
• +13 more

31.thomhurst / ModularPipelines

Write your pipelines in C# !

• build
• build-system
• build-tool
• build-tools
• csharp
• pipeline
• +6 more

32.go-mysql-org / go-mysql

a powerful mysql toolset with Go

33.ankane / pgsync

Sync data from one Postgres database to another

• postgresql

34.piskvorky / smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

• python
• s3
• hdfs
• webhdfs
• boto
• streaming
• +5 more

35.goptics / varmq

A Simplest in-memory and Distributed Storage-Agnostic Message Queue for Your Concurrent Go Program

• concurrency
• go
• goroutine
• priority-queue
• queue
• worker
• +6 more

36.smrchy / rsmq

Redis Simple Message Queue

• rsmq
• queue
• message-queue
• fifo
• redis
• nodejs
• +1 more

37.pyjanitor-devs / pyjanitor

Clean APIs for data cleaning. Python implementation of R package Janitor

• pandas
• dataframe
• data
• cleaning-data
• data-engineering
• pydata
• +1 more

38.nnnkkk7 / snowflake-emulator

A lightweight Snowflake emulator built with Go and DuckDB for local development and testing

• cicd
• database
• docker
• duckdb
• emulator
• go
• +10 more

39.commanded / commanded

Use Commanded to build Elixir CQRS/ES applications

• cqrs
• elixir
• cqrs-es
• cqrs-framework
• event-sourcing
• commanded
• +1 more

40.EasyNetQ / EasyNetQ

An easy to use .NET API for RabbitMQ

• rabbitmq
• messaging
• dotnet
• dotnet-core

41.reugn / go-streams

A lightweight stream processing library for Go

• stream-processing
• pipeline
• etl
• kafka
• data-stream
• kafka-streams
• +14 more

42.thangchung / clean-architecture-dotnet

🕸 Yet Another .NET Clean Architecture, but for Microservices project. It uses Minimal Clean Architecture with DDD-lite, CQRS-lite, and just enough Cloud-native patterns apply on the simple eCommerce sample and run on Tye with Dapr extension 🍻

• ddd
• ddd-architecture
• ddd-patterns
• clean-architecture
• microservices
• microservices-architecture
• +14 more

43.spatie / laravel-failed-job-monitor

Get notified when a queued job fails

• laravel
• php
• queue
• monitor
• notifications
• slack

44.indeedeng / iwf

iWF is a Workflow-As-Code microservice orchestration platform offering an orchestration coding framework and service for building resilient, fault-tolerant, scalable long-running processes

• golang
• workflow
• distributed-system
• orchestration
• orchestrator
• workflow-as-code
• +11 more

45.pancsta / asyncmachine-go

state machine which runs code

• golang
• workflows
• state-machine
• actor-model
• aop
• consensus
• +14 more

46.kgrzybek / sample-dotnet-core-cqrs-api

Sample .NET Core REST API CQRS implementation with raw SQL and DDD using Clean Architecture.

• ddd
• ddd-example
• cqrs
• cqrs-simple
• rest-api
• dotnet
• +13 more

47.datafold / data-diffArchived

Compare tables within or across databases

• database
• mysql
• postgresql
• snowflake
• rdbms
• trino
• +14 more

48.RailsEventStore / rails_event_store

A Ruby implementation of an Event Store based on Active Record

• ruby
• event-sourcing
• rails
• ddd
• aggregate-root
• event-driven
• +4 more

49.microsoft / Trill

Trill is a single-node query processor for temporal or streaming data.

• streaming-data
• temporal-data

50.commanded / eventstore

Event store using PostgreSQL for persistence

• cqrs
• eventstore
• elixir
• event-sourcing
• postgresql
• database
• +2 more

51.gammazero / deque

Fast ring-buffer deque (double-ended queue)

• deque
• queue
• ring-buffer
• circular-buffer
• circular-queue

52.adrianbrad / queue

⏪️ Go package providing multiple queue implementations. Developed in a thread-safe generic way.

• generic
• golang
• queue
• thread-safe
• go
• blocking-queue
• +3 more

53.liyue201 / gostl

Data structure and algorithm library for go, designed to provide functions similar to C++ STL

• list
• vector
• deque
• queue
• stack
• set
• +9 more

54.aelassas / wexflow

Workflow Automation Engine

• workflow-engine
• workflow
• cross-platform
• automation
• wexflow
• csharp
• +3 more

55.andreiavrammsd / cpp-channel

C++11 thread-safe container for sharing data between threads (synchronized queue)

• cpp
• multithreading
• thread-safe
• channel
• concurrent-queue
• queue
• +2 more

56.MrPowers / chispa

PySpark test helper methods with beautiful error messages

• pyspark
• testing

57.mikestefanello / backlite

Type-safe, persistent, embedded task queues and background job runner w/ SQLite. Web monitoring UI included.

• go
• golang
• job-queue
• job-scheduler
• jobs
• queue
• +13 more

58.microsurging / surging

Surging is a micro-service engine that provides a lightweight, high-performance, modular RPC request pipeline. support Event-based Asynchronous Pattern and reactive programming.

• microservices
• apigateway
• surging
• rabbitmq
• messagepack
• protobuffer
• +14 more

59.dotnet / spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

• spark
• csharp
• dotnet
• analytics
• bigdata
• spark-streaming
• +14 more

60.mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

• etl
• data-integration
• python
• postgresql
• pipeline
• data

61.Allenxuxu / gev

🚀Gev is a lightweight, fast non-blocking TCP network library / websocket server based on Reactor mode. Support custom protocols to quickly and easily build high-performance servers.

• epoll-tcp-server
• kqueue
• golang
• reactor
• nonblocking
• epoll
• +9 more

62.message-db / message-db

Microservice native message and event store for Postgres

• event-store
• event-sourcing
• event-driven
• pub-sub
• event-stream
• message-queue
• +1 more

63.jf-tech / omniparser

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

• transform
• etl
• xml
• json
• csv
• fixed-length
• +13 more

64.charlessolar / Aggregates.NET

.NET event sourced domain driven design model via NServiceBus and GetEventStore

• eventstore
• nservicebus
• ddd
• eventsourcing
• microservices
• cqrs

65.litenova / LiteBus

Modular .NET messaging for commands, queries, events, durable inbox and outbox processing, sagas, and broker transports.

• cqrs
• cqs
• csharp
• dotnet-core
• mediator
• eventbus
• +3 more

66.Protocol-Lattice / GoEventBus

GoEventBus — high-performance event bus with a decision layer.

• golang
• library
• event-driven
• concurrency
• event-driven-architecture
• pubsub
• +8 more

67.rbmuller / scherlok

A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.

• anomaly-detection
• bigquery
• cli
• data-engineering
• data-observability
• data-quality
• +14 more

68.chronicle-app / chronicle-etl

📜 A CLI toolkit for extracting and working with your digital history

• chronicle
• chronicle-etl
• personal-data
• etl
• cli
• archiving
• +7 more

69.php-enqueue / enqueue-dev

Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro

• message-queue
• message-bus
• rabbitmq
• amqp
• stomp
• job-queue
• +14 more

70.Clivern / Beaver

💨 A real time messaging system to build a scalable in-app notifications, multiplayer games, chat apps in web and mobile apps.

• pusher
• beaver
• websocket
• pubsub
• socket-io
• realtime
• +4 more

71.Cinchoo / ChoETL

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

• csv
• parser
• writer
• reader
• flat
• xml
• +11 more

72.jorgebucaran / spark.fish

▁▂▄▆▇█▇▆▄▂▁

• spark
• fish-plugin
• fish

73.mehdihadeli / Go-MediatR

🚃 A library for handling mediator patterns and simplified CQRS patterns within an event-driven architecture, inspired by csharp MediatR library.

• cqrs
• golang
• mediator
• mediator-pattern
• go
• golang-package

74.brunch / brunch

🍴 Web applications made easy. Since 2011.

• javascript
• workflow
• build-automation
• pipeline
• brunch

75.szilard / benchm-ml

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

• machine-learning
• data-science
• r
• python
• gradient-boosting-machine
• random-forest
• +4 more

76.wellle / rmq

Message queue system written in Go and backed by Redis

• go
• golang
• redis
• message-queue

77.orlangure / gnomock

Test your code without writing mocks with ephemeral Docker containers 📦 Setup popular services with just a couple lines of code ⏱️ No bash, no yaml, only code 💻

• go
• golang
• testing
• integration-testing
• end-to-end-testing
• docker
• +14 more

78.gazette / core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

• golang
• event-sourcing
• stream-processing
• brokers
• streaming-platforms

79.dopebase / messenger-iOS-chat-swift-firestore

Messenger Clone - Real-time iOS Chat with Firebase Firestore written in Swift

• swift
• firebase-firestore
• messenger
• xcode
• whatsapp
• discord
• +14 more

80.hamed-shirbandi / TaskoMask

Task management system based on .NET 8 with Microservices, DDD, CQRS, Event Sourcing and Testing Concepts

• ddd
• event-sourcing
• cqrs
• bdd
• microservices
• clean-architechture
• +14 more

81.weyoss / redis-smq

RedisSMQ: A high-performance Redis message queue for Node.js

• redis
• background-jobs
• brokers
• dead-letter-queue
• delayed-jobs
• distributed-systems
• +14 more

82.LGouellec / streamiz

.NET Stream Processing Library for Apache Kafka 🚀

• kafka-streams-dotnet
• kafka-streams
• kafka-streams-net
• kafka
• event-streaming
• streamiz

83.fieldryand / goflow

Simple but powerful DAG scheduler and dashboard

• directed-acyclic-graph
• airflow
• dashboard
• go
• job-scheduler
• schedule
• +1 more

84.nilenso / goose

A powerful background job processing library for Clojure

• clojure
• redis
• asynchronous
• background-processing
• batch-processing
• rabbitmq
• +1 more

85.zeromq / lzmq

Lua binding to ZeroMQ

• lua-bindings
• zeromq
• ffi
• messaging
• lua
• zmq

86.flow-php / parquet

PHP ETL - parquet library

87.cujojs / most

Ultra-high performance reactive programming

88.asaskevich / EventBus

[Go] Lightweight eventbus with async compatibility for Go

• event-driven
• golang

89.shzlw / poli

An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.

• business-intelligence
• sql
• dashboard
• data-visualization
• sql-editor
• jdbc
• +4 more

90.bottenderjs / messaging-apis

Messaging APIs for multi-platform

• messaging
• messenger
• line
• api-client
• chatbot
• slack
• +4 more

91.jorge07 / symfony-7-es-cqrs-boilerplate

Symfony 7 DDD ES CQRS backend boilerplate.

• symfony
• event-sourcing
• cqrs
• cqrs-es
• ddd
• symfony-flex
• +3 more

92.microsoft / MobiusArchived

C# and F# language binding and extensions to Apache Spark

• spark
• apache-spark
• rdd
• dataframe
• dstream
• dataset
• +10 more

93.pdpipe / pdpipe

Easy pipelines for pandas DataFrames.

• pandas
• pandas-dataframe
• pipeline
• data
• data-science
• dataframe
• +1 more

94.andreschaffer / event-sourcing-cqrs-examples

Event Sourcing and CQRS in practice.

• event-sourcing
• cqrs
• ddd
• domain-driven-design
• hexagonal-architecture
• events
• +3 more

95.helgeho / ArchiveSpark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving
• webarchive
• internet-archive
• +1 more

96.Steema / TeeBI

Data-mining and Visualization components for RAD Studio

• visualization
• complex-structures
• database
• charting-library
• multidimensional-data
• query-engine
• +7 more

97.groda / big_data

Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.

• big-data
• bigdata
• spark
• spark-sql
• docker
• mapreduce
• +13 more

98.joseferben / pocketbase-queue

A type-safe queue for background tasks using PocketBase.

• background-jobs
• pocketbase
• queue
• typescript
• workers

99.wisp-trading / wisp

Wisp CLI — Interactive trading platform for backtesting and live trading across spot, perpetual futures, options, and prediction markets

• algorithmic-trading
• cryptocurrency
• event-driven
• go
• golang
• trading-algorithms
• +2 more

100.qvcloud / broker

A production-grade messaging abstraction for Go. It provides a unified API to decouple business logic from various brokers including Kafka, RabbitMQ, RocketMQ, NATS, Redis, and AWS SQS. Featuring built-in OpenTelemetry integration and engineered for high reliability.

• go
• kafka
• message-broker
• opentelemetry
• rabbitmq
• redis
• +5 more