A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
47,133 repositories indexed
1–2 of 2 · Most stars
47,133 repositories indexed
1–2 of 2 · Most stars
A high-throughput and memory-efficient inference and serving engine for LLMs
Open-source personal AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-agent, multi-model, multi-channel. Lightweight, extensible, one-line install.