1.jundot / omlxLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu barapple-siliconinference-serverllmmacosmlxopenai-apiPythonAPACHE-2.023K total2.1K forks+4,972 starsfrom 18,297 · score 8.51