Nix User Repository: User contributed nix packages [maintainer=@Pandapip1]
- nur
- nixpkgs
- overlays
- nix-packages
100,822 visible repositories in the index
1–2 of 2 · Most stars
Nix User Repository: User contributed nix packages [maintainer=@Pandapip1]
FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.