LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Repository Index
47,133 repositories indexed
1–2 of 2 · Most stars
Get the global cache directory
- cache
- caching
- directory
- filesystem
47,133 repositories indexed
1–2 of 2 · Most stars
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Get the global cache directory