Skip to content

fix(ml): pad attention heads for openvino - #74

Open
mertalev wants to merge 1 commit into
mainfrom
feat/openvino-head-pad
Open

mertalev wants to merge 1 commit into
mainfrom
feat/openvino-head-pad

Conversation

@mertalev

@mertalev mertalev commented Oct 6, 2026

Copy link
Copy Markdown
Member

OpenVINO doesn't handle unaligned head sizes correctly, leading to NaN's sometimes appearing in the results. This PR pads as a workaround, which is a more targeted fix than disabling SDPA or oneDNN altogether.

@mertalev
mertalev requested a review from bo0tzz October 6, 2026 03:56

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants