1.jundot / omlxLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu barapple-siliconinference-serverllmmacosmlxopenai-apiPythonAPACHE-2.023K total2.1K forks+219 starsfrom 23,050 · score 5.39