Add Intel Arc GPU support on Linux - #75
elyerinfox wants to merge 3 commits into
Conversation
Adds an Intel detector (xpu-smi when installed, sysfs fallback) that runs in parallel with the existing NVIDIA path, so mixed hosts report every adapter. Signed-off-by: elyerinfox <elycin2@gmail.com>
Reports real Arc VRAM totals and dynamic memory-used on stock i915 kernels that don't expose the mem_info_vram_* sysfs attributes. Signed-off-by: elyerinfox <elycin2@gmail.com>
MINOR: adds Intel Arc GPU inventory to /v1/node-info on Linux (additive HTTP surface). Rolls the product/installer line to 0.92.0. Signed-off-by: elyerinfox <elycin2@gmail.com>
|
@elyerinfox I'd be interested to hear how you things go with that GPU here? |
Currently on the clock, but I can give it a look at some point in the coming days. Any particular out of the three or just wanting to see how ARC integrates generally? |
It's supposed to probe and pull the correct version of llama.cpp for your hardware, the order is this: cuda, rocm, vulkan, cpu But maybe it should actually be? cuda, rocm, openvino, vulkan, cpu But maybe vulkan is more suited and it's ok as is, I don't know? I don't have the hardware to integrate it and make an informed call. |
Reading the room here, this is probably one of the most absurd PRs that an individual could possibly open on this repository.
As an outsider, I clearly don't know the relationship between NVIDIA and Intel at present, but given that this project has already started integrating other ecosystems such as MacOS I figured it was worth a shot.
Anyways.... The goal is on the tin.
Description
This PR aims to start adding support for Intel ARC graphics cards into this project. The rationale is....ARC cards are cheap memory and they're surprisingly capable, probably not economical given this isn't anything with HMB, but if you have a handful of these cards like me just kicking around then this is probably for you.
Scope
In:
Out:
Validation
Risk
Checklist
git commit -s), certifying the Developer Certificate of Origin.services/versions.json, and described user-visible changes above so they reach the release notes.