DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Repository Index
100,822 visible repositories in the index
1–9 of 9 · Most stars
Locally run an Instruction-Tuned Chat-Style LLM
Modern, secure, portable, multiprotocol bootloader and boot manager.
- bootloader
- bios
- x86
- x86-64
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)
- rdma
- hpc
- networking
- infiniband
This tool provides an efficient implementation of the continuous bag-of-words and skip-gram architectures for computing vector representations of words. These representations can be subsequently used in many natural language processing applications and for further research.
maxxing the ability to run different LLMs on the smallest devices possible
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
- avx2
- c
- cpu-inference
- gguf
Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell built into the app.