LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Repository Index
47,133 repositories indexed
1–3 of 3 · Most stars
Run many AI agents at once on your Mac, up to 3x faster.
- agents
- apple-silicon
- artificial-intelligence
- inference-acceleration
A Long-Horizon Benchmark for Self-Improving Inference Systems