Repository Index

Production ready toolkit to run AI locally

• ios
• kotlin
• llm
• swift

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

• privacy-first
• gguf
• llama-cpp
• local-ai

BYOK voice recording companion with ASR transcription, speaker diarization, AI summaries, and local ASR endpoint support.

• bluetooth-low-energy
• byok
• privacy
• speech-to-text

llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

• homebrew
• llama-cpp
• llm
• playstation-5