DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Repository Index
107,098 visible repositories in the index
1–6 of 6 · Most stars
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
- avx2
- c99
- cpu-inference
- deep-learning
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)
- rdma
- hpc
- networking
- infiniband
Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deployment, Windows desktop deployment, and Android deployment
- asr
- ctranslate2
- huggingface
- whisper
Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell built into the app.