🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- bloom
- deep-learning
- distributed-systems
- language-models
47,133 repositories indexed
1–2 of 2 · Most stars
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Kafka-style message streaming in Go. Built on NATS. Single binary, no JVM, no ZooKeeper.