A high-throughput and memory-efficient inference and serving engine for LLMs
Repository Index
47,133 repositories indexed
1–2 of 2 · Most stars
Hopsworks - Data-Intensive AI platform with a Feature Store
47,133 repositories indexed
1–2 of 2 · Most stars
A high-throughput and memory-efficient inference and serving engine for LLMs
Hopsworks - Data-Intensive AI platform with a Feature Store