LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
47,133 repositories indexed
1–1 of 1 · Most stars
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar