DeepEP: an efficient expert-parallel communication library
Repository Index
142,273 visible repositories in the index
1–2 of 2 · Most stars
NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process communication and coordination overheads by allowing programmers to perform one-sided communication from within CUDA kernels and on CUDA streams.
- communciations
- cpp
- cuda
- deep-learning