A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
- avx2
- c99
- cpu-inference
- deep-learning
142,187 visible repositories in the index
1–11 of 11 · Most stars
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
Software in C and data files for the popular GloVe model for distributed word representations, a.k.a. word vectors or embeddings
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)
This tool provides an efficient implementation of the continuous bag-of-words and skip-gram architectures for computing vector representations of words. These representations can be subsequently used in many natural language processing applications and for further research.
Automatically exported from code.google.com/p/word2vec
React Native binding of llama.cpp
maxxing the ability to run different LLMs on the smallest devices possible
The simplest and lowest-cost AI integration solution. If you like this project, please give it a Star~ | 最简单、最低成本的AI接入方案。喜欢本项目的话点个 Star 吧~
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
Local LLM, image&video&music generator