Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
47,133 repositories indexed
1–22 of 22 · Most stars
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
- etl
- sql
- bigquery
- cloud-native
The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
- clickhouse
- kakfa
- sql
- redpanda
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
- data
- ingestion
- replication
- management
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
- data-engineering
- data-integration
- data-pipeline
- data-quality
TranslatedOntiCards is an enterprise-oriented AI Data Hub that offers one-stop capabilities around business databases: data source connection, metadata understanding, natural language query, cross-source fusion, data quality inspection, query auditing, data asset management, and more
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
- go
- data-integration
- etl
- data-pipeline
Distributed Data Transfer Service for MySQL
- mysql
- data-transfer
- data-migration
- replication
MySQL to PostgreSQL replica system
- python
- postgresql
- mysql
- mysql-replication
Enhanced PostgreSQL logical replication
- postgresql
- logical-replication
- golang
Postgres change events (CDC) in Elixir [WAL]
- cdc
- change-data-capture
- elixir
- postgres
Streaming Postgres logical replication changes atleast-once over websockets
- postgresql
- logical-replication
- write-ahead-log
- websockets
Time-series database and pub/sub messaging server for IoT and real-time devices, in Go: an embeddable storage engine with TTLs, wildcard topics and encryption, and a clustered server over gRPC, TCP and WebSocket with replication and rolling upgrades.
Build and deploy a serverless data pipeline on AWS with no effort.
- aws-cdk
- data-pipeline
- stepfunctions
- glue
Scramjet Platform is a distributed runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters without exposing network ports to the public internet.
- nodejs
- stream-processing
- transform-as-a-service
- real-time
Stream database events from PostgreSQL to Kafka
- postgresql
- events
- stream
- kafka
Use AWS CDK with CodePipeline to deploy a TypeScript Create-React-App.
- aws-cdk
- aws-codepipeline
- cra-pipeline
- react
Gatling plugin for Apache Kafka — produce, request-reply, and consume load testing with Avro, Protobuf, and Schema Registry support
- gatling
- kafka
- performance
- performance-testing
Stateful actors on Apache Flink 2.x and Java 21 — durable per-key state, exactly-once messaging, Kafka and Kinesis I/O, Kubernetes-native deployment. Continues the Apache Stateful Functions programming model on the modern Flink line.
- actor-model
- apache-flink
- distributed-systems
- event-driven
Gatling plugin for AMQP/RabbitMQ — publish, request-reply, and consume patterns with connection pooling
- amqp
- gatling
- gatling-plugin
- performance
Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.
- collaborative-editing
- conflict-resolution
- crdt
- data-engineering