LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Repository Index
104,105 visible repositories in the index
1–3 of 3 · Most stars
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
- apple-silicon
- local-llm
- macos
- mlx
MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.
- llm
- lmstudio
- macbook
- mlx