DeepEP: an efficient expert-parallel communication library
Repository Index
142,273 visible repositories in the index
1–7 of 7 · Most stars
Scenic: A Jax Library for Computer Vision Research and Beyond
A bidirectional pipeline parallelism algorithm for computation-communication overlap in DeepSeek V3/R1 training.
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
- ai
- allreduce
- amd
- broadcom
Collective communications library with various primitives for multi-machine training.
- collectives
- distributed-training
- pytorch
A fast communication-overlapping library for tensor/expert parallelism on GPUs.
Whole-body motion tracking for the Unitree G1 in under a minute. BlinkMimic's world-model trainer rebuilt in JAX, 3.7x faster on four H100s.