Repository Index

Learn how to develop, deploy and iterate on production-grade ML applications.

• machine-learning
• deep-learning
• pytorch
• natural-language-processing

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

• applied-machine-learning
• production
• applied-data-science
• machine-learning

Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

• orchestration
• data-orchestration
• high-availability
• infrastructure-as-code

Workflow Engine for Kubernetes

• workflow
• kubernetes
• argo
• dag

Incremental engine for long horizon agents 🌟 Star if you like it!

• ai
• change-data-capture
• data-indexing
• etl

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

• database
• stream-processing
• rust
• postgresql

Fancy stream processing made operationally mundane

• message-queue
• stream-processing
• streaming-data
• message-bus

Python Stream Processing

• python
• stream-processing
• rust
• data-engineering

Python Streaming DataFrames for Kafka

• kafka
• python
• stream-processing
• data-engineering

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

• data-analytics
• data-cleaning
• data-cleansing
• data-engineering