Repository Index

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

• ray
• distributed
• parallel
• machine-learning

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

• deep-learning
• document-parsing
• machine-learning
• nlp

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

• dbt-viewpoint
• slack
• pypa
• data-modeling

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

• bloom
• deep-learning
• distributed-systems
• language-models

Build, Manage and Deploy AI/ML Systems

• machine-learning
• model-management
• ai
• ml

Apache Beam is a unified programming model for Batch and Streaming data processing.

• python
• java
• big-data
• beam

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

• data-drift
• jupyter-notebook
• pandas-dataframe
• machine-learning

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

• machine-learning
• ml
• model-validation
• data-validation

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

• datalake
• lakehouse
• metadata
• federated-query

An ultra-lightweight and blazing-fast Messaging Bus/MQTT Broker for Edge & SDV

• mqtt
• mqtt-broker
• iot-edge
• nng

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

• analytics
• bigquery
• data-modeling
• data-pipelines

Hopsworks - Data-Intensive AI platform with a Feature Store

• feature-store
• aws
• azure
• data-science

Microservices library - scalecube-services is a high throughput, low latency reactive microservices library built to scale. It features: API-Gateways, service-discovery, service-load-balancing, the architecture supports plug-and-play service communication modules and features. built to provide performance and low-latency real-time stream-processing

• microservices
• reactive-streams
• distributed-systems
• service-mesh

An implementation of Actor, Publish-Subscribe, and CSP models in one rather small C++ framework. With performance, quality, and stability proved by years in the production.

• cpp
• cplusplus
• cplusplus-17
• actor-model

.NET event sourced domain driven design model via NServiceBus and GetEventStore

• eventstore
• nservicebus
• ddd
• eventsourcing

A state-of-the-art distributed system using Reactive DDD as uncertainty modeling, Event Storming as subdomain decomposition, Event Sourcing as an eventual persistence mechanism, CQRS, Async Projections, Microservices for individual deployable units, Event-driven Architecture for efficient integration, and Clean Architecture as domain-centric design

• cqrs
• ddd
• clean-architecture
• event-sourcing

[Go]Distributed Actor/Grain framework for Golang with goodies

• actor-model
• actors
• actorsystem
• golang

Spawn - Actor Mesh

• actorsystem
• concurrency
• distributed-systems
• kubernetes

Monad, Functional Programming features for Golang

• golang
• functional-programming
• functional-reactive-programming
• reactive

state machine which runs code

• golang
• workflows
• state-machine
• actor-model

BENERATOR is a leading software solution to generate, obfuscate, pseudonymize and migrate data for development, testing, and training purposes with a model-driven approach.

• testdata
• anonymization
• migration
• performance-testing

Functional domain models with event sourcing in Elixir

GoEventBus — high-performance event bus with a decision layer.

• golang
• library
• event-driven
• concurrency

Stateful actors on Apache Flink 2.x and Java 21 — durable per-key state, exactly-once messaging, Kafka and Kinesis I/O, Kubernetes-native deployment. Continues the Apache Stateful Functions programming model on the modern Flink line.

• actor-model
• apache-flink
• distributed-systems
• event-driven