Repository Index

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

• airflow
• apache
• apache-airflow
• python

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

• data-drift
• jupyter-notebook
• pandas-dataframe
• machine-learning

Real-time monitor and web admin for Celery distributed task queue

• celery
• task-queue
• monitoring
• administration

A network event stream processing system, in Clojure.

• riemann
• events
• clojure
• monitoring

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

• machine-learning
• ml
• model-validation
• data-validation

Ruby and Rails efficient Kafka processing framework

• karafka-framework
• kafka
• kafka-client
• kafka-clients

Data validation toolkit for assessing and monitoring data quality.

• data-validation
• tabular-data
• data-testing
• data-quality

StreamFlow™ is a stream processing tool designed to help build and monitor processing workflows.

Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching

• serverless-framework
• streaming
• stream-processing
• qt

Type-safe, persistent, embedded task queues and background job runner w/ SQLite. Web monitoring UI included.

• go
• golang
• job-queue
• job-scheduler

Scalable Full History API Solution for Antelope (former EOSIO) based blockchains

• antelope
• api
• big-data
• blockchain

A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.

• anomaly-detection
• bigquery
• cli
• data-engineering