You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Feature Request: Please add Linux SYCL build for release. #228
Thanks for adding a SYCL build to the binaries! Now to get it to work... ;) In the mean time I rebuilt this repo with the .devops/intel.Dockerfile from $upstream (to get the 2026 oneAPI) and lo and behold, my output token speed doubled compared to using Vulkan on a Intel ARC B60. I used to get ~8t/s, it runs at 16t/s now (PQ2_0). Way more gooder.
Activity
kiljoy001 commentedon Sep 23, 2026
You might want to test out my pr: #235
PrivateCaller commentedon Sep 23, 2026
Chiming in to support this. I can't get the SYCL backend to compile properly on Windows, and the Vulkan backend is very slow.
FOTempel commentedon Oct 7, 2026
Apparently it's merged, so what would it take to also release a SYCL build from now on?
FOTempel commentedon Oct 10, 2026
Thanks for adding a SYCL build to the binaries! Now to get it to work... ;) In the mean time I rebuilt this repo with the .devops/intel.Dockerfile from $upstream (to get the 2026 oneAPI) and lo and behold, my output token speed doubled compared to using Vulkan on a Intel ARC B60. I used to get ~8t/s, it runs at 16t/s now (PQ2_0). Way more gooder.