A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
Repository Index
132,241 visible repositories in the index
1–16 of 16 · Most stars
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Locally run an Instruction-Tuned Chat-Style LLM
Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案,结构参考alpaca
- llama
- alpaca
- chinese
- vicuna
Pure C inference of Mistral Voxtral Realtime 4B speech to text model
This tool provides an efficient implementation of the continuous bag-of-words and skip-gram architectures for computing vector representations of words. These representations can be subsequently used in many natural language processing applications and for further research.
Automatically exported from code.google.com/p/word2vec
maxxing the ability to run different LLMs on the smallest devices possible
The most atomic way to train and inference a GPT in pure, dependency-free C
- artificial-intelligence
- c
- c-programming
- deep-learning
Port of OpenAI's Whisper model in C/C++ with xtts and wav2lip
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
- avx2
- c
- cpu-inference
- gguf
Local LLM, image&video&music generator
A minimal, fast, graphical UEFI boot manager written in C. no external dependencies — just a config file :)
- bootloader
- bootmanager
- ricing
- ricing-linux
A tiny experimental language designed to be targeted by coding LLMs
- llm
- new-language-design
- thought-exercise
- vibe-coding
A 9-billion-parameter language model running on a PS4 GPU. Offline.
Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell built into the app.