Fix: Enhanced mha - #5

Open

JanCSEM wants to merge 6 commits into

pulp-platform:develfrom

JanCSEM:enhanced-mha

Commits on Dec 1, 2025

Fix scaling factor Tensor -> Float conversion if Tensor has more than 1 element
JanCSEM
committed
8890e21
Allow for node arguments to be a tuple or list
JanCSEM
committed
1d4f293
Fix MHA to return a tuple for consistency with pytorch and brevitas implementations
JanCSEM
committed
9402356

Commits on Dec 2, 2025

Add batch first handling in unrolled MHA
JanCSEM
committed
eeaeb26
Add tests for channel wise weight quantization
JanCSEM
committed
648155a
Merge branch 'channel-wise-scales' into enhanced-mha
JanCSEM
committed
2fb3708