Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
- gemma
- gpgpu
- llm
- local-ai
132,241 visible repositories in the index
1–24 of 36 · Most stars
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
Native macOS menu bar app to use your Claude Code & ChatGPT subscriptions with AI coding tools - no API keys needed
A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.
The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works on Windows, Linux, & macOS, with the free Gemini API, local LLMs, & more.
Query your Apple Health data with natural language 💬 🩺
Mac app for Ollama
A cosy home for your LLMs.
A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.
This is a wrapper library around the ChatGPT and OpenAI HTTP API
Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.
Chat with your favourite LLaMA models in a native macOS app
An API-compatible, drop-in replacement for Apple's Foundation Models framework with support for custom language model providers.
All-in-one native macOS AI chat application for virtually any AI provider
Claude Code skills for Apple platform development (iOS, macOS, iPadOS) — product validation, code generation, App Store optimization, and more
OpenAI-compatible API server for Apple on-device models
🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.
Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API. One File. Pure Swift
An open-source, macOS text action popup for running custom scripts, AI actions, and extensible workflows on selected text.
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
🎤 The easiest way to transcribe audio in Swift
macOS menubar app for fast local DeepSeek V4.1, with 1M context.