Skip to content

sparse decode attention: CUDA graphs, P/D, asynchronous decode, token pipelines and preemption - #164

Open
0z5a wants to merge 36 commits into
InferMatrixLab:mainfrom
0z5a:pr157-stack-on-head
Open

0z5a wants to merge 36 commits into
InferMatrixLab:mainfrom
0z5a:pr157-stack-on-head

Walk pipeline suspensions through the cycle in the sparse preemption …

44737aa
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
lint and CPU unit tests
succeeded Nov 2, 2026 in 2m 8s