Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
25–48 of 237 · Most stars
:boy: :girl: Technical-Interview guidelines written for those who started studying programming. I wish you all the best. :space_invader:
- development
- beginner
- tech-interviews
- awesome
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
- pytorch
- speech-recognition
- paraformer
- punctuation
TranslatedTechnical architecture of internet companies: the architectures of WeChat/Taobao/Weibo/Tencent/Alibaba/Meituan-Dianping/Baidu/OpenAI/Google/Facebook/Amazon/eBay. PRs to add more are welcome
- architecture
- architecture-guidelines
- internet-architecutre
- architecture-of-internet-product
Turns Data and AI algorithms into production-ready web applications in no time.
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
- python
- luigi
- orchestration-framework
- scheduling
🎮 The only Front-End Performance Checklist that runs faster than the others
- frontend
- front-end-development
- front-end-developer-tool
- guidelines
Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.
Workflow Engine for Kubernetes
- workflow
- kubernetes
- argo
- dag
OpenAI Baselines: high-quality implementations of reinforcement learning algorithms
An orchestration platform for the development, production, and observation of data assets.
- data-pipelines
- dagster
- workflow
- data-science
Structured Outputs
- generative-ai
- llms
- prompt-engineering
- symbolic-ai
TranslatedChinese copywriting guidelines for better written communication / A guide to Chinese copy typesetting
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
- deep-learning
- document-parsing
- machine-learning
- nlp
Your new Mentor for Data Science E-Learning.
- tensorflow
- machine-learning
- machine-vision
- datascience
Powerline is a statusline plugin for vim, and provides statuslines and prompts for several other applications, including zsh, bash, tmux, IPython, Awesome and Qtile.
- python
- statusline
- prompt
- vim
Unified framework for building enterprise RAG pipelines with small, specialized models
- parsing
- retrieval-augmented-generation
- agents
- generative-ai-tools
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
- workflow-schedule
- azkaban
- airflow
- task-scheduler
Comprehensive language-agnostic guidelines on variables naming. Home of the A/HC/LC pattern.
- naming
- naming-conventions
- naming-cheatsheet
- cheatsheet
PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.
- reinforcement-learning
- reinforcement-learning-algorithms
- machine-learning
- gym
The complete guide to static typing in "React & Redux" apps using TypeScript
Docker implemented in around 100 lines of bash
Kubescape is an open-source Kubernetes security platform for your IDE, CI/CD pipelines, and clusters. It includes risk analysis, security, compliance, and misconfiguration scanning, saving Kubernetes users and administrators precious time, effort, and resources.
- kubernetes
- security
- nsa
- mitre-attack
Programming style, best practices, and coding conventions.
- awesome
- guidelines
- coding-conventions
- style-conventions