A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
Repository Index
102,118 visible repositories in the index
1–8 of 8 · Most stars
Software in C and data files for the popular GloVe model for distributed word representations, a.k.a. word vectors or embeddings
llama and other large language models on iOS and MacOS offline using GGML library.
- ai
- ggml
- gpt-2
- gptneox
Python bindings for the Transformer models implemented in C/C++ using GGML library.
- ai
- llm
- transformers
- ctransformers
This tool provides an efficient implementation of the continuous bag-of-words and skip-gram architectures for computing vector representations of words. These representations can be subsequently used in many natural language processing applications and for further research.
Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deployment, Windows desktop deployment, and Android deployment
- asr
- ctranslate2
- huggingface
- whisper
maxxing the ability to run different LLMs on the smallest devices possible
Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell built into the app.