Trending repositories

1.ModernRelay / omnigraph

Object-storage native graph database with branching and typed ontology

• apache-arrow
• datafusion
• graph-database
• knowledge-graph
• lakehouse
• lance
• +5 more

2.bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

• bloom
• deep-learning
• distributed-systems
• language-models
• large-language-models
• machine-learning
• +14 more

3.ThreeDotsLabs / watermill

Building event-driven applications the easy way in Go.

• watermill
• event-driven
• event-sourcing
• sagas
• events
• stream-processing
• +7 more

4.svix / svix-webhooks

The open source and enterprise-ready webhooks service 🦀

• webhooks
• rust
• webhook-server
• webhook-service
• webhook
• webhooks-server
• +13 more

5.Data-Centric-AI-Community / fg-data-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

• pandas-profiling
• pandas-dataframe
• statistics
• jupyter-notebook
• exploration
• data-science
• +14 more

6.meltano / meltano

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

• dataops
• dataops-platform
• elt
• open-source
• opensource
• data
• +14 more

7.onetimesecret / onetimesecret

Keep passwords and other sensitive information out of your chat logs and inboxes.

• privacy
• onetime
• secrets
• chat
• email
• messaging
• +1 more

8.unionai-oss / pandera

A light-weight, flexible, and expressive statistical data testing library

• pandas
• validation
• schema
• dataframes
• testing
• pandas-validation
• +12 more

9.graphile / worker

High performance Node.js/PostgreSQL job queue (also suitable for getting jobs generated by PostgreSQL triggers/functions out into a different work queue)

• postgresql
• node
• worker
• job-queue
• graphile
• nodejs
• +2 more

10.nanomq / nanomq

An ultra-lightweight and blazing-fast Messaging Bus/MQTT Broker for Edge & SDV

• mqtt
• mqtt-broker
• iot-edge
• nng
• aio
• actor-model
• +14 more

11.containrrr / shoutrrr

Notification library for gophers and their furry friends.

• notifications
• golang
• go
• messaging
• integrations
• hacktoberfest

12.nsqio / nsq

A realtime distributed messaging platform

• go
• messaging
• distributed-systems
• queue
• message-queue
• nsq

13.narwhals-dev / narwhals

Lightweight and extensible compatibility layer between dataframe libraries!

• cudf
• ibis
• pandas
• polars
• pyarrow
• dask
• +2 more

14.IBM / sarama

Sarama is a Go library for Apache Kafka.

• kafka
• kafka-client
• go

15.destel / rill

Composable concurrency toolkit for Go

• concurrency
• channels
• go
• golang
• pipeline

16.developit / mitt

🥊 Tiny 200 byte functional event emitter / pubsub.

• mitt
• event-handlers
• pubsub
• tiny
• event
• event-bus
• +2 more

17.dotnet / reactive

The Reactive Extensions for .NET

18.dotnetcore / CAP

Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern

• kafka
• rabbitmq
• distributed-transactions
• outbox-pattern
• eventbus
• microservices
• +1 more

19.BrighterCommand / Brighter

A framework for building messaging apps with .NET and C#.

• command-processor
• command-dispatcher
• brighter
• asynchronously
• nuget-packages
• scale
• +11 more

20.laravel / horizon

Dashboard and code-driven configuration for Laravel queues.

• laravel
• queue

21.max0x7ba / atomic_queue

C++14 concurrent lock-free low-latency queue.

• lock-free
• lockfree
• atomics
• queue
• multithreading
• low-latency
• +14 more

22.ChunelFeng / CGraph

Translated【A common used C++ & Python DAG framework】 A general-purpose, third-party-dependency-free, cross-platform parallel computing framework based on flow graphs, listed in awesome-cpp. Welcome to star & fork & discuss

• dag
• workflow
• taskflow
• pipeline
• graph
• ai
• +2 more

23.thomhurst / ModularPipelines

Write your pipelines in C# !

• build
• build-system
• build-tool
• build-tools
• csharp
• pipeline
• +6 more

24.ekazaev / ChatLayout

ChatLayout is an alternative solution to MessageKit. It uses custom UICollectionViewLayout to provide you full control over the presentation as well as all the tools available in UICollectionView. It supports dynamic cells and supplementary view sizes.

• chat
• chat-application
• messaging
• messenger
• uicollectionviewlayout
• collectionview
• +7 more

25.go-mysql-org / go-mysql

a powerful mysql toolset with Go

26.pydoit / doit

CLI task management & automation tool

• python
• build-tool
• build-automation
• task-runner
• build-system
• workflow-management
• +6 more

27.Tochemey / goakt

[Go]Distributed Actor/Grain framework for Golang with goodies

• actor-model
• actors
• actorsystem
• golang
• golang-library
• distributed-systems
• +13 more

28.bitloops / ddd-hexagonal-cqrs-es-eda

Complete working example of using Domain Driven Design (DDD), Hexagonal Architecture, CQRS, Event Sourcing (ES), Event Driven Architecture (EDA), Behaviour Driven Development (BDD) using TypeScript and NestJS. Like what you see? Don't forget to star! ⭐ ^^^

• bdd
• cqrs
• ddd
• domain-driven-design
• event-sourcing
• hexagonal-architecture
• +9 more

29.phongnguyend / Practical.CleanArchitecture

Full-stack .Net 10 Clean Architecture (Microservices, Modular Monolith, Monolith), Blazor, Angular 22, React 19, Vue 3.5, BFF with YARP, NextJs 16, Domain-Driven Design, CQRS, SOLID, Asp.Net Core Identity Custom Storage, OpenID Connect, EF Core, OpenTelemetry, SignalR, Background Services, Health Checks, Rate Limiting, Clouds (Azure, AWS, GCP), ...

• cqrs
• domain-driven-design
• clean-architecture
• oauth2
• signalr
• docker
• +13 more

30.boazsegev / facil.io

Your high performance web application C framework

• websocket-server
• http-protocol
• http-parser
• c
• concurrency
• framework
• +7 more

31.commanded / commanded

Use Commanded to build Elixir CQRS/ES applications

• cqrs
• elixir
• cqrs-es
• cqrs-framework
• event-sourcing
• commanded
• +1 more

32.ankane / pgsync

Sync data from one Postgres database to another

• postgresql

33.RailsEventStore / rails_event_store

A Ruby implementation of an Event Store based on Active Record

• ruby
• event-sourcing
• rails
• ddd
• aggregate-root
• event-driven
• +4 more

34.piskvorky / smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

• python
• s3
• hdfs
• webhdfs
• boto
• streaming
• +5 more

35.indeedeng / iwf

iWF is a Workflow-As-Code microservice orchestration platform offering an orchestration coding framework and service for building resilient, fault-tolerant, scalable long-running processes

• golang
• workflow
• distributed-system
• orchestration
• orchestrator
• workflow-as-code
• +11 more

36.adrianbrad / queue

⏪️ Go package providing multiple queue implementations. Developed in a thread-safe generic way.

• generic
• golang
• queue
• thread-safe
• go
• blocking-queue
• +3 more

37.boazsegev / iodine

iodine - HTTP / WebSockets Server for Ruby with Pub/Sub support

• ruby
• server
• pubsub
• sse
• clustering
• high-performance
• +5 more

38.pyjanitor-devs / pyjanitor

Clean APIs for data cleaning. Python implementation of R package Janitor

• pandas
• dataframe
• data
• cleaning-data
• data-engineering
• pydata
• +1 more

39.aelassas / wexflow

Workflow Automation Engine

• workflow-engine
• workflow
• cross-platform
• automation
• wexflow
• csharp
• +3 more

40.gammazero / deque

Fast ring-buffer deque (double-ended queue)

• deque
• queue
• ring-buffer
• circular-buffer
• circular-queue

41.goptics / varmq

A Simplest in-memory and Distributed Storage-Agnostic Message Queue for Your Concurrent Go Program

• concurrency
• go
• goroutine
• priority-queue
• queue
• worker
• +6 more

42.EasyNetQ / EasyNetQ

An easy to use .NET API for RabbitMQ

• rabbitmq
• messaging
• dotnet
• dotnet-core

43.datafold / data-diffArchived

Compare tables within or across databases

• database
• mysql
• postgresql
• snowflake
• rdbms
• trino
• +14 more

44.reugn / go-streams

A lightweight stream processing library for Go

• stream-processing
• pipeline
• etl
• kafka
• data-stream
• kafka-streams
• +14 more

45.asaskevich / EventBus

[Go] Lightweight eventbus with async compatibility for Go

• event-driven
• golang

46.pancsta / asyncmachine-go

state machine which runs code

• golang
• workflows
• state-machine
• actor-model
• aop
• consensus
• +14 more

47.thangchung / clean-architecture-dotnet

🕸 Yet Another .NET Clean Architecture, but for Microservices project. It uses Minimal Clean Architecture with DDD-lite, CQRS-lite, and just enough Cloud-native patterns apply on the simple eCommerce sample and run on Tye with Dapr extension 🍻

• ddd
• ddd-architecture
• ddd-patterns
• clean-architecture
• microservices
• microservices-architecture
• +14 more

48.commanded / eventstore

Event store using PostgreSQL for persistence

• cqrs
• eventstore
• elixir
• event-sourcing
• postgresql
• database
• +2 more

49.litenova / LiteBus

Modular .NET messaging for commands, queries, events, durable inbox and outbox processing, sagas, and broker transports.

• cqrs
• cqs
• csharp
• dotnet-core
• mediator
• eventbus
• +3 more

50.nnnkkk7 / snowflake-emulator

A lightweight Snowflake emulator built with Go and DuckDB for local development and testing

• cicd
• database
• docker
• duckdb
• emulator
• go
• +10 more

51.spatie / laravel-failed-job-monitor

Get notified when a queued job fails

• laravel
• php
• queue
• monitor
• notifications
• slack

52.MrPowers / chispa

PySpark test helper methods with beautiful error messages

• pyspark
• testing

53.liyue201 / gostl

Data structure and algorithm library for go, designed to provide functions similar to C++ STL

• list
• vector
• deque
• queue
• stack
• set
• +9 more

54.smrchy / rsmq

Redis Simple Message Queue

• rsmq
• queue
• message-queue
• fifo
• redis
• nodejs
• +1 more

55.andreiavrammsd / cpp-channel

C++11 thread-safe container for sharing data between threads (synchronized queue)

• cpp
• multithreading
• thread-safe
• channel
• concurrent-queue
• queue
• +2 more

56.dotnet / spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

• spark
• csharp
• dotnet
• analytics
• bigdata
• spark-streaming
• +14 more

57.Protocol-Lattice / GoEventBus

GoEventBus — high-performance event bus with a decision layer.

• golang
• library
• event-driven
• concurrency
• event-driven-architecture
• pubsub
• +8 more

58.mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

• etl
• data-integration
• python
• postgresql
• pipeline
• data

59.jf-tech / omniparser

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

• transform
• etl
• xml
• json
• csv
• fixed-length
• +13 more

60.LGouellec / streamiz

.NET Stream Processing Library for Apache Kafka 🚀

• kafka-streams-dotnet
• kafka-streams
• kafka-streams-net
• kafka
• event-streaming
• streamiz

61.mikestefanello / backlite

Type-safe, persistent, embedded task queues and background job runner w/ SQLite. Web monitoring UI included.

• go
• golang
• job-queue
• job-scheduler
• jobs
• queue
• +13 more

62.microsoft / Trill

Trill is a single-node query processor for temporal or streaming data.

• streaming-data
• temporal-data

63.gazette / core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

• golang
• event-sourcing
• stream-processing
• brokers
• streaming-platforms

64.wellle / rmq

Message queue system written in Go and backed by Redis

• go
• golang
• redis
• message-queue

65.Cinchoo / ChoETL

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

• csv
• parser
• writer
• reader
• flat
• xml
• +11 more

66.bottenderjs / messaging-apis

Messaging APIs for multi-platform

• messaging
• messenger
• line
• api-client
• chatbot
• slack
• +4 more

67.orlangure / gnomock

Test your code without writing mocks with ephemeral Docker containers 📦 Setup popular services with just a couple lines of code ⏱️ No bash, no yaml, only code 💻

• go
• golang
• testing
• integration-testing
• end-to-end-testing
• docker
• +14 more

68.weyoss / redis-smq

RedisSMQ: A high-performance Redis message queue for Node.js

• redis
• background-jobs
• brokers
• dead-letter-queue
• delayed-jobs
• distributed-systems
• +14 more

69.brunch / brunch

🍴 Web applications made easy. Since 2011.

• javascript
• workflow
• build-automation
• pipeline
• brunch

70.message-db / message-db

Microservice native message and event store for Postgres

• event-store
• event-sourcing
• event-driven
• pub-sub
• event-stream
• message-queue
• +1 more

71.pdpipe / pdpipe

Easy pipelines for pandas DataFrames.

• pandas
• pandas-dataframe
• pipeline
• data
• data-science
• dataframe
• +1 more

72.sizovs / PipelinR

PipelinR is a lightweight command processing pipeline ❍ ⇢ ❍ ⇢ ❍ for your Java awesome app.

• java
• architecture
• service-layer
• pipes-and-filters
• mediator
• mediatr
• +5 more

73.fieldryand / goflow

Simple but powerful DAG scheduler and dashboard

• directed-acyclic-graph
• airflow
• dashboard
• go
• job-scheduler
• schedule
• +1 more

74.nilenso / goose

A powerful background job processing library for Clojure

• clojure
• redis
• asynchronous
• background-processing
• batch-processing
• rabbitmq
• +1 more

75.flow-php / parquet

PHP ETL - parquet library

76.php-enqueue / enqueue-dev

Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro

• message-queue
• message-bus
• rabbitmq
• amqp
• stomp
• job-queue
• +14 more

77.Bhupesh-V / 30-seconds-of-cppArchived

30 Seconds of C++ (STL in C++). Read More about 30C++ here 👉

• cpp11
• cpp14
• stl-containers
• stl-algorithms
• stl-vector
• standard-template-library
• +8 more

78.jorgebucaran / spark.fish

▁▂▄▆▇█▇▆▄▂▁

• spark
• fish-plugin
• fish

79.microsoft / MobiusArchived

C# and F# language binding and extensions to Apache Spark

• spark
• apache-spark
• rdd
• dataframe
• dstream
• dataset
• +10 more

80.andreschaffer / event-sourcing-cqrs-examples

Event Sourcing and CQRS in practice.

• event-sourcing
• cqrs
• ddd
• domain-driven-design
• hexagonal-architecture
• events
• +3 more

81.charlessolar / Aggregates.NET

.NET event sourced domain driven design model via NServiceBus and GetEventStore

• eventstore
• nservicebus
• ddd
• eventsourcing
• microservices
• cqrs

82.mehdihadeli / Go-MediatR

🚃 A library for handling mediator patterns and simplified CQRS patterns within an event-driven architecture, inspired by csharp MediatR library.

• cqrs
• golang
• mediator
• mediator-pattern
• go
• golang-package

83.chronicle-app / chronicle-etl

📜 A CLI toolkit for extracting and working with your digital history

• chronicle
• chronicle-etl
• personal-data
• etl
• cli
• archiving
• +7 more

84.groda / big_data

Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.

• big-data
• bigdata
• spark
• spark-sql
• docker
• mapreduce
• +13 more

85.szilard / benchm-ml

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

• machine-learning
• data-science
• r
• python
• gradient-boosting-machine
• random-forest
• +4 more

86.jakubkulhan / bunny

Performant pure-PHP AMQP (RabbitMQ) sync/async (ReactPHP) library

• amqp
• amqp-client
• amqp0-9-1
• php
• php-library
• rabbitmq

87.AntonioFalcaoJr / EventualShop

A state-of-the-art distributed system using Reactive DDD as uncertainty modeling, Event Storming as subdomain decomposition, Event Sourcing as an eventual persistence mechanism, CQRS, Async Projections, Microservices for individual deployable units, Event-driven Architecture for efficient integration, and Clean Architecture as domain-centric design

• cqrs
• ddd
• clean-architecture
• event-sourcing
• event-driven
• eda
• +14 more

88.helgeho / ArchiveSpark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving
• webarchive
• internet-archive
• +1 more

89.etlkit / etlkit

EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.

• dotnet
• dotnet-core
• etl
• etl-framework

90.wisp-trading / wisp

Wisp CLI — Interactive trading platform for backtesting and live trading across spot, perpetual futures, options, and prediction markets

• algorithmic-trading
• cryptocurrency
• event-driven
• go
• golang
• trading-algorithms
• +2 more

91.cujojs / most

Ultra-high performance reactive programming

92.edgurgel / poxa

Pusher server implementation compatible with Pusher client libraries.

• pusher
• elixir
• pubsub
• websocket

93.jorge07 / symfony-7-es-cqrs-boilerplate

Symfony 7 DDD ES CQRS backend boilerplate.

• symfony
• event-sourcing
• cqrs
• cqrs-es
• ddd
• symfony-flex
• +3 more

94.adidas / api-guidelines

adidas group API design guidelines

• api
• guidelines
• rest
• rest-api
• architecture
• http
• +7 more

95.BEagle1984 / silverback

Silverback is a message bus and broker integration library for .NET. It is designed to simplify event-driven architectures and asynchronous messaging, with first-class support for Apache Kafka and MQTT.

• microservice
• messaging
• kafka
• silverback
• message-bus
• message-brokers
• +6 more

96.Steema / TeeBI

Data-mining and Visualization components for RAD Studio

• visualization
• complex-structures
• database
• charting-library
• multidimensional-data
• query-engine
• +7 more

97.joseferben / pocketbase-queue

A type-safe queue for background tasks using PocketBase.

• background-jobs
• pocketbase
• queue
• typescript
• workers

98.shzlw / poli

An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.

• business-intelligence
• sql
• dashboard
• data-visualization
• sql-editor
• jdbc
• +4 more

99.dereuromark / cakephp-queue

Queue plugin for CakePHP - simple, pure PHP and without dependencies.

• asynchronous
• background-jobs
• cronjob
• queue
• cakephp
• cakephp-plugin
• +1 more

100.synacker / daggy

Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching

• serverless-framework
• streaming
• stream-processing
• qt
• aggregation
• process
• +7 more