Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
- airflow
- apache
- apache-airflow
- python
Repository Index
47,133 repositories indexed
1–16 of 16 · Most stars
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
- telegraf
- monitoring
- time-series
- metrics
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
- data-drift
- jupyter-notebook
- pandas-dataframe
- machine-learning
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
Real-time monitor and web admin for Celery distributed task queue
- celery
- task-queue
- monitoring
- administration
📌 异步线程池框架，支持线程池动态变更&监控&报警，无需修改代码轻松引入。Asynchronous thread pool framework, support Thread Pool Dynamic Change & monitoring & Alarm, no need to modify the code easily introduced.
- java
- thread-pool
- dynamic
- monitor
A network event stream processing system, in Clojure.
- riemann
- events
- clojure
- monitoring
Ruby and Rails efficient Kafka processing framework
- karafka-framework
- kafka
- kafka-client
- kafka-clients
pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].
- netflow
- ipfix
- sflow
- bgp
Enterprise Network Flow Collector (IPFIX, sFlow, Netflow)
- network
- ipfix
- sflow
- golang
Get notified when a queued job fails
StreamFlow™ is a stream processing tool designed to help build and monitor processing workflows.
Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching
- serverless-framework
- streaming
- stream-processing
- qt
Type-safe, persistent, embedded task queues and background job runner w/ SQLite. Web monitoring UI included.
- go
- golang
- job-queue
- job-scheduler
Scalable Full History API Solution for Antelope (former EOSIO) based blockchains
- antelope
- api
- big-data
- blockchain
A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.
- anomaly-detection
- bigquery
- cli
- data-engineering