Universal LLM Deployment Engine with ML Compilation
- llm
- machine-learning-compilation
- language-model
- tvm
47,133 repositories indexed
1–5 of 5 · Most stars
Universal LLM Deployment Engine with ML Compilation
Transpile trained scikit-learn estimators and transformers to C, C#, Go, Java, JavaScript, PHP and Ruby.
Dataflow compiler for QNN inference on FPGAs
Laya typed decisions on Linux x86_64 via ONNX Runtime
Deploy tensorflow graphs for fast evaluation and export to tensorflow-less environments running numpy.