MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.
Repository Index
103,113 visible repositories in the index
1–1 of 1 · Most stars