The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
- apple-intelligence
- apple-silicon
- cli
- foundationmodels
132,241 visible repositories in the index
1–4 of 4 · Most stars
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
An API-compatible, drop-in replacement for Apple's Foundation Models framework with support for custom language model providers.
OpenAI-compatible API server for Apple on-device models
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.