OmO: Just type "mass ulw" keyword with your prompt. Now you are the master of graph engineering.
Repository Index
47,133 repositories indexed
1–24 of 61 · Most stars
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
- airflow
- apache
- apache-airflow
- python
Learn how to design systems at scale and prepare for system design interviews
- architecture
- distributed-systems
- system-design
- system-design-interview
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
- orchestration
- data-orchestration
- high-availability
- infrastructure-as-code
If you want to become good at AI engineering & system design, join this newsletter 👇
- computer-science
- interview-questions
- software-engineering
- system-design
What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
- semantic-search
- information-retrieval
- ai
- python
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Machine Learning Engineering Open Book
Turns Data and AI algorithms into production-ready web applications in no time.
Workflow Engine for Kubernetes
- workflow
- kubernetes
- argo
- dag
Release engineering, simplified
- release-automation
- package
- hacktoberfest
- github-actions
Learn ML engineering for free in 4 months! Register here 👇🏼
A curated list of references for MLOps
- machine-learning
- mlops
- data-science
- engineering
Open-source feature management platform
- feature
- feature-toggle
- unleash
- feature-flags
A curated list of Site Reliability and Production Engineering resources.
- site-reliability-engineering
- production
- availability
- monitoring
Roadmap to becoming a data engineer in 2021
- data-engineer-roadmap
- data-engineering
- cloud
- roadmap
eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.
- kubernetes
- golang
- rest
- grpc
Meshery, the cloud native manager
- meshery
- management-plane
- hacktoberfest
- kubernetes
vCluster creates tenant clusters: fully isolated environments delivered as managed Kubernetes, or as the foundation for Slurm, Ray, Run:ai and inference clusters. Each gets its own API server, CRDs and RBAC, and runs on an existing cluster or standalone on bare metal. CNCF Certified Kubernetes.
- kubernetes
- vcluster
- virtual-clusters
- multi-tenancy
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
- xonsh
- devops
- iterm2
- data-engineering