Skip to content

perf(cuda): widen the attention query tile on sm_89 and sm_120 - #202

Open
sysuTobo wants to merge 6 commits into
InferMatrixLab:mainfrom
sysuTobo:cuda/attention-wide-tile
Open

perf(cuda): widen the attention query tile on sm_89 and sm_120#202
sysuTobo wants to merge 6 commits into
InferMatrixLab:mainfrom
sysuTobo:cuda/attention-wide-tile

cuda: key the wide-tile decision to the current device

2bbf255
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs