Universal LLM Deployment Engine with ML Compilation
- llm
- machine-learning-compilation
- language-model
- tvm
47,133 repositories indexed
1–2 of 2 · Most stars
Universal LLM Deployment Engine with ML Compilation
Open-source platform for AI chat agents that answer from your own knowledge base. Hybrid RAG search in PostgreSQL, MCP and custom tools, guardrails and human handoff. Put agents on a hosted chat page, a website widget, Slack, Teams, WhatsApp, Telegram or a REST API. Self-host with Docker and open-weight models.