Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
Repository Index
47,133 repositories indexed
49–72 of 332 · Most stars
Streamlink is a CLI utility which pipes video streams from various services into a video player
- streamlink
- python
- livestream
- twitch
Kubescape is an open-source Kubernetes security platform for your IDE, CI/CD pipelines, and clusters. It includes risk analysis, security, compliance, and misconfiguration scanning, saving Kubernetes users and administrators precious time, effort, and resources.
- kubernetes
- security
- nsa
- mitre-attack
Connect APIs, remarkably fast. Free for developers.
- eventsourcing
- event-sourcing
- automation
- workflow
Spug is a lightweight agent-free automatic operation and maintenance platform designed for small and medium-sized enterprises. It integrates host management, host batch execution, host online terminal, file management, application release and deployment, pipelines, online task planning, configuration center, monitoring, alarm and so on.
- ops
- operations
- devops
- webssh
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
- kedro
- hacktoberfest
- mlops
- python
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid search in less than 2kb.
- data-structures
- full-text
- search
- typo-tolerance
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
An alternative privacy-friendly YouTube frontend which is efficient by design.
The Python package installer
- pip
- python
- packaging
A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Mac app that shows all open files, directories, sockets, pipes and devices in use by all running processes. Nice GUI for lsof.
- macos
- osx
- lsof
- open-files
AlphaFold 3 inference pipeline.
CLI tool and python library that converts the output of popular command-line tools, file-types, and common strings to JSON, YAML, or Dictionaries. This allows piping of output to tools like jq and simplifying automation scripts.
- parsers
- json
- linux
- command-line
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- data
- data-cleaning
- data-pipelines
- data-processing
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
- data-drift
- jupyter-notebook
- pandas-dataframe
- machine-learning
Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.
- steampipe
- postgresql
- postgresql-fdw
- cloud
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
Integrate React.js with Rails views and controllers, the asset pipeline, or webpacker.