A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
Repository Index
88,573 visible repositories in the index
1–8 of 8 · Most stars
Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca
- llama
- alpaca
- chinese
- vicuna
Modern, secure, portable, multiprotocol bootloader and boot manager.
- bootloader
- bios
- x86
- x86-64
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
This tool provides an efficient implementation of the continuous bag-of-words and skip-gram architectures for computing vector representations of words. These representations can be subsequently used in many natural language processing applications and for further research.
Automatically exported from code.google.com/p/word2vec
Llama 2 Everywhere (L2E)
- cosmopolitan
- multios
- blas
- blis
maxxing the ability to run different LLMs on the smallest devices possible