The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
- cloud-computing
- deep-learning
- gpu
- hyperparameter-tuning
96,838 visible repositories in the index
1–21 of 21 · Most stars
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments
Redis-based components for Scrapy.
A utility for managing proot containers.
Build, Store, and Distribute your Applications and Containers
Ansible playbooks to deploy Ceph, the distributed filesystem.
An open, distributed platform as a service
Examples of programs built using Modal
Redis for humans. 🌎🌍🌏
Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.
Making data lake work for time series
The blessed :octocat: GitHub Action, for publishing your :package: distribution files to PyPI, the tokenless way: https://github.com/marketplace/actions/pypi-publish
Self-hosted Chrome → NAS pipeline: capture HLS / DASH / MP4 streams from any site and download to your NAS. Single multi-arch Docker image (FastAPI + worker + ffmpeg) distributed via GHCR.
Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.
TensorFlow code for the neural network presented in the paper: "code2vec: Learning Distributed Representations of Code"
Docker Swarm mode rocks! Ideas, tools and recipes. Get a production-ready, distributed, HTTPS served, cluster in minutes, not weeks.
AWS Least Privilege for Distributed, High-Velocity Deployment
The Docker-based Open edX distribution designed for peace of mind
YAS3FS (Yet Another S3-backed File System) is a Filesystem in Userspace (FUSE) interface to Amazon S3. It was inspired by s3fs but rewritten from scratch to implement a distributed cache synchronized by Amazon SNS notifications. A web console is provided to easily monitor the nodes of a cluster.
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
Generate a GitHub stats SVG for your GitHub Profile README in GitHub Actions