A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
- avx2
- c99
- cpu-inference
- deep-learning
107,098 visible repositories in the index
1–6 of 6 · Most stars
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
Modern, secure, portable, multiprotocol bootloader and boot manager.
Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)
Llama 2 Everywhere (L2E)
React Native binding of llama.cpp
maxxing the ability to run different LLMs on the smallest devices possible