Retrieval and Retrieval-augmented LLMs
- embeddings
- information-retrieval
- llm
- sentence-embeddings
47,133 repositories indexed
1–3 of 3 · Most stars
Retrieval and Retrieval-augmented LLMs
MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.
Gemini CLI wrapped as a Docker image, so you don't need to trash your OS with Node and it's dependencies.