Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
- kedro
- hacktoberfest
- mlops
- python
Repository Index
47,133 repositories indexed
49–72 of 299 · Most stars
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
🌌 A complete search engine and RAG pipeline in your browser, server or edge network with support for full-text, vector, and hybrid search in less than 2kb.
- data-structures
- full-text
- search
- typo-tolerance
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
An alternative privacy-friendly YouTube frontend which is efficient by design.
A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Mac app that shows all open files, directories, sockets, pipes and devices in use by all running processes. Nice GUI for lsof.
- macos
- osx
- lsof
- open-files
AlphaFold 3 inference pipeline.
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- data
- data-cleaning
- data-pipelines
- data-processing
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
- data-drift
- jupyter-notebook
- pandas-dataframe
- machine-learning
Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.
- steampipe
- postgresql
- postgresql-fdw
- cloud
The leader in Customer Data Infrastructure
- snowplow
- analytics
- data
- data-pipeline
Integrate React.js with Rails views and controllers, the asset pipeline, or webpacker.
🍴 Web applications made easy. Since 2011.
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Cross-platform Audio Visualizer
- alsa
- audio-visualizer
- freebsd
- glsl-shaders
📚 Parameterize, execute, and analyze notebooks
- jupyter
- notebooks
- notebook-generator
- nteract
TranslatedMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. Training medical large models, implementing incremental pre-training (PT), supervised fine-tuning (SFT), RLHF, DPO, ORPO, and GRPO.
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
- mlops
- machine-learning
- data-science
- production-ready
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
- cloud-native
- streaming
- rust
- real-time