Skip to content

CUDA: fast, batch-invariant small-batch PTQ1_0 mat-vec (1.5x decode on Ampere) - #218

Open
sudoingX wants to merge 11 commits into
PrismML-Eng:prismfrom
sudoingX:pr-ptq1-mmv
Open

sudoingX wants to merge 11 commits into
PrismML-Eng:prismfrom
sudoingX:pr-ptq1-mmv

Fix: wait on the PDL dependency in the PTQ1_0 mat-vec kernel before r…

efe1a06
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
labeler
succeeded Oct 10, 2026 in 17s