Skip to content

[KV] Opt-in FP8 e4m3 KV cache with per-vector scales - #129

Open
0z5a wants to merge 7 commits into
InferMatrixLab:mainfrom
0z5a:kv/fp8-kv-cache
Open

[KV] Opt-in FP8 e4m3 KV cache with per-vector scales#129
0z5a wants to merge 7 commits into
InferMatrixLab:mainfrom
0z5a:kv/fp8-kv-cache

Commits

  1. Commits on Oct 15, 2026

  2. Commits on Oct 16, 2026

  3. Commits on Oct 21, 2026

  4. Commits on Nov 1, 2026