1.jundot / omlxLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu barapple-siliconinference-serverllmmacosmlxopenai-apiPythonAPACHE-2.023K total2.1K forks+11,042 starsfrom 12,227 · score 9.31