Skip to content

[KV] Opt-in FP8 e4m3 KV cache with per-vector scales - #129

Open
0z5a wants to merge 7 commits into
InferMatrixLab:mainfrom
0z5a:kv/fp8-kv-cache
Open

0z5a wants to merge 7 commits into
InferMatrixLab:mainfrom
0z5a:kv/fp8-kv-cache

Run the merged FP8 tests on GPUs with less shared memory

fbfeaad
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
lint and CPU unit tests
succeeded Nov 1, 2026 in 2m 13s