Repository Index

Distribute and run LLMs with a single file.

• cross-platform
• gguf
• llama-cpp
• local-ai

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

• agent
• llm
• rag
• vector-database

🦎 A lightweight, streaming-native, multi-protocol gateway for AI, APIs, and real-time data. Route LLM requests across providers, govern MCP tools, and connect Kafka, MQTT, and HTTP through one high-performance engine with shared security and observability.

• kafka
• rest
• server-sent-events
• streaming-api