Universal LLM Deployment Engine with ML Compilation
- llm
- machine-learning-compilation
- language-model
- tvm
47,133 repositories indexed
1–3 of 3 · Most stars
Universal LLM Deployment Engine with ML Compilation
Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.