🪓 An orchestration engine for background tasks, AI agents, and durable workflows
Repository Index
47,133 repositories indexed
25–48 of 98 · Most stars
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
The Open Source Feature Store for AI/ML
Real-time monitor and web admin for Celery distributed task queue
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
Python Stream Processing
the portable Python dataframe library
📚 Parameterize, execute, and analyze notebooks
macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.
🌊 Online machine learning in Python
a little task queue for python
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Event-driven networking engine written in Python.
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Apache Avro is a data serialization system.
Messaging library for Python.
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
WebSocket and WAMP in Python for Twisted and asyncio
Apache DataFusion Ballista Distributed Query Engine
CLI task management & automation tool
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow