Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
Repository Index
47,133 repositories indexed
1–24 of 24 · Most stars
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
- kedro
- hacktoberfest
- mlops
- python
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
- mlops
- machine-learning
- data-science
- production-ready
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
- asyncapi
- reactive
- specification
- websockets
The open source and enterprise-ready webhooks service 🦀
- webhooks
- rust
- webhook-server
- webhook-service
Self-hosted platform to unify wearable health data through one AI-ready API.
- wearables
- apple-health
- apple-watch
- fitness
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
Data API Framework for AI Agents and Data Apps
An implementation of Actor, Publish-Subscribe, and CSP models in one rather small C++ framework. With performance, quality, and stability proved by years in the production.
- cpp
- cplusplus
- cplusplus-17
- actor-model
C++11 thread-safe container for sharing data between threads (synchronized queue)
- cpp
- multithreading
- thread-safe
- channel
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
- data-analytics
- data-cleaning
- data-cleansing
- data-engineering
Go concurrent-safe, goroutine-safe, thread-safe queue
- golang
- go
- concurrency
- concurrent
⏪️ Go package providing multiple queue implementations. Developed in a thread-safe generic way.
- generic
- golang
- queue
- thread-safe
Distributed C++ services from embedded to enterprise
Modular, Production-Ready, Open-Source EHR
- ehr
- electronic-health-record
- fhir
- health
An observable microservice bus library for .NET, that wraps the underlying message transports in simple Rx based interfaces.
- messaging
- microservices
- servicebus
- observable
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
- spark
- neo4j-connector
- cypher
- neo4j-driver
DDD+CQRS+Event-sourcing examples using EventFlow following CQRS-ES architecture. It is configured with RabbitMQ, MongoDB(Snapshot store), PostgreSQL(Read store), EventStore(GES). It's targeted to .Net Core 2.2 and include docker compose file.
- eventflow
- cqrs
- cqrs-es-architecture
- ges
Read and write Neuroglancer datasets programmatically.
- neuroglancer
- volumetric-data
- python
- cloud
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.
A micro workers class that easily manages a pool of threads to optimise simultaneous jobs and jobs endings, for MicroPython (used on Pycom modules & ESP32)
- pycom
- micropython
- lopy
- wipy
EtlKit is a lightweight ETL (extract · transform · load) library and data integration toolbox for .NET. Build your own data pipelines programmatically in C# — readable, testable, and tracked in source control like the rest of your code.
- dotnet
- dotnet-core
- etl
- etl-framework
Estimating the number of clusters in a data set via the gap statistic. Implemented in H2O-3
- kmeans
- kmeans-clustering
- clustering
- gap-statistic
Implementation of Partitioning Around Medoids (PAM) in H2O-3
- clustering
- machine-learning
- h2o-3
- java