Repository Index

2bit quants, kernels and runtime for consumer devices.

• android
• framework
• ios
• llamacpp

Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.

• cuda
• glm
• glm-5
• llm

Cross-vendor 3D Gaussian Splatting trainer - video to splat to mesh, Vulkan or CUDA.

• 3d-gaussian-splatting
• gaussian-splatting
• 3d-reconstruction
• 3dgs

Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM): ~33 tok/s on agent tasks, ~41 in fast mode, 512K context. Plus GLM-5.3-Flash, Qwen3.8 and LFM3-Omni. MoE experts tiered across VRAM, pinned RAM and NVMe, with Xolotl Direct NVMe->VRAM. OpenAI + Anthropic API.

• cuda
• deepseek
• deepseek-v4
• gguf

Official library for RaBitQ vector quantization and approximate nearest-neighbor search, in C++ and Python.

• nearest-neighbor-search
• quantization
• vector-database
• vector-search