1.jundot / omlxLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu barapple-siliconinference-serverllmmacosmlxopenai-apiPythonAPACHE-2.023K total2.1K forks+829 starsfrom 22,440 · score 6.72