Repository Index

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

• bloom
• deep-learning
• distributed-systems
• language-models

AWS ParallelCluster is an AWS supported Open Source cluster management tool to deploy and manage HPC clusters in the AWS cloud.

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

• hpc
• workflow
• workflow-automation
• workflow-management

Parallel uploads to Amazon AWS S3

• s3
• python
• s3-parallel
• parallel

40K, small memory footprint, single binary that run list of commands in parallel and waits for their termination

• cli
• wait
• util
• bash

Utilities to do parallel upload/download with Amazon S3

🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines

• etl
• etl-framework
• etl-pipeline
• python