Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.
- golang
- llama
- localllama
- localllm
90,854 visible repositories in the index
1–2 of 2 · Most stars
Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.
Message queue system written in Go and backed by Redis