Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention
Repository Index
108,094 visible repositories in the index
1–4 of 4 · Most stars
PerfKit Benchmarker (PKB) contains a set of benchmarks to measure and compare cloud offerings. The benchmarks use default settings to reflect what most users will see. PerfKit Benchmarker is licensed under the Apache 2 license terms. Please make sure to read, understand and agree to the terms of the LICENSE and CONTRIBUTING files before proceeding.
A comparison between some VPS providers. It uses Ansible to perform a series of automated benchmark tests over the VPS servers that you specify. It allows the reproducibility of those tests by anyone that wanted to compare these results to their own. All the tests results are available in order to provide independence and transparency.
- vps
- ansible
- comparison
- python
The repository host gives no description.