A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
Repository Index
79,841 visible repositories in the index
1–3 of 3 · Most stars
Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)
- rdma
- hpc
- networking
- infiniband
This tool provides an efficient implementation of the continuous bag-of-words and skip-gram architectures for computing vector representations of words. These representations can be subsequently used in many natural language processing applications and for further research.