Repository navigation
ledger(H7x): REFUTED on the Xeon 6741P; OVMS decodes 1.22x EAT 1.1.0's vLLM CPU engine at matched 16-bit weights - #286
Merged
Merged
Conversation
….28.0 at matched 16-bit weights) H7x ran once on the Xeon 6741P on 2026-11-01 (14:37-15:22Z), to its pre-registration and amendment V1, from main at 9978945 with EAT's chart at release-1.1.0 (0c726f57). Setup smoke 7 came first, as V1 requires: B Ready in 115 s, C in 126 s, no request sent. All 11 blocks ran (A B B A A B B A A B, then C) with no void block and no restart. Median decode was 12.964 tok/s for OVMS 2026.4.1 on the fp16 IR and 10.607 tok/s for EAT's stock vLLM CPU v0.28.0 in bf16: R = 1.222, R_bw 1.222, and every one of the five block pairs lies between 1.214 and 1.248. bench/apb/h7x.py reads REFUTED. Reported only: C/B 1.130 (one block), prefill TTFT on ~1870 tokens B 2.08 s against A 3.00 s, decode incremental J/token A 3.61, B 4.17. The records are under bench/xhost/results/2026-11-01/H7x/ (the hold, the campaign log and the render pre-check) and bench/xhost/results/2026-10-21/H7x-smokes/smoke7/. The technical report moves H7x from PENDING to REFUTED and recounts.
…ing-CPU wording The repo's .gitignore drops every *.log, so the first commit left out the logs that several H7x statements rest on: the hold's start and stop stamps (14:37:24-15:22:13Z, 2689 s), the per-block engine start and ready stamps, smoke 7's B Ready 115 s and C Ready 126 s, the lock taken at once, and the launcher's "No accelerators requested". The pre-registration also asks for each smoke's hold.log to be committed, and smokes 1-6 already have theirs. These eight files are force-added, copied from crescent's runs/ directory and byte-identical to the copies the run's numbers were read from: the hold's hold.log and chain.log, its run directory's up.log and energy.log, the campaign log, and smoke 7's hold.log, chain.log and up.log. The kubeconfig and its lock stay out. No number changes. The Reproduce header now names them. The background disclosure said the two SGLang serving pairs used 2.10-2.38 CPUs. That range is serving.jsonl's serving_cpu, the sum over every listed container. It now says so, and gives the two pairs alone: 1.86-2.12 CPUs, median 1.99, over the same 268 samples.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
H7x (H7 run to its full protocol on the Xeon 6741P, pre-registration #196, amendment V1 #235) ran once on crescent on 2026-11-01 and reads REFUTED.
What ran
~/k3dgpu-xhost/k3d-gpu-h7xmoved from 986887b (the PR ledger(H7x): pre-register H7 to its full protocol on the Xeon 6741P #196 branch) to main at 9978945 (0.1.85).~/k3dgpu-xhost/eat-srcmoved from 0d3438d to EAT release-1.1.0 (0c726f57), as V1's Reproduce says; its chart passedh7x.sh's sha256 check.bench/xhost/tools.shhad already run at 13:29Z), helm v4.1.1, node imagecryptoandcoffee/k3d-gpu:0.1.61(sha256:8cd264aa...).H7X_RENDER_ONLY=1, no cluster): against smoke 6, only the vLLM image and the pod'sfsGroup: 1001changed, the limit is the fit's 22Gi, as V1 describes. OVMS keeps the pre-registered digest; main'sagent manifestnow also names its2026.4.1-gputag.bench/xhost/hold.shon the shared bench lock. It started at once (load1 3.16, no aiperf process, disk 32%) and took 2689 s of its 10800 s cap. It was the only H7x hold: one hold of a cap of one.Result
All 11 blocks (A B B A A B B A A B, then C) are valid. No pod restarted. All 198 scored requests were ok with their full output.
--enforce-eager(1 block)bench/apb/h7x.pyreads REFUTED. Re-scoring the copied records here gives byte-identical output.Changes
EXPERIMENTS.md:docs/intel/technical-report.md: REFUTED goes to 19 and PENDING to 11 (rebased onto H60's ledger(H60): SUPPORTED on the Xeon 6741P; Flash-Next reads 0.82 of the Gemma control's DRAM share #285). H7x is added to the REFUTED table, to the list of rows that changed no default, and to the list of Xeon-host rows.bench/xhost/results/2026-11-01/H7x/hold/: every file of the run, without the kubeconfig..gitignoredrops*.log, sohold.log,chain.logand the run directory'sup.logandenergy.logare force-added; each is byte-identical to crescent's copy.bench/xhost/results/2026-11-01/H7x/render-precheck/bench/xhost/results/2026-11-01/H7x/campaign.log(force-added the same way)bench/xhost/results/2026-10-21/H7x-smokes/smoke7/, next to smokes 1-6 as V1 asks, with itshold.log,chain.logandup.logforce-added the same way.Disclosures
intel-gpu-pluginran on the older launcher, and this run cannot say whether it ran this time. No arm requests a GPU. This run's launcher printed "No accelerators requested".serving_cpu, the sum over every listed container) used 2.10-2.38 CPUs throughout (median 2.24), of which the two SGLang serving pairs 1.86-2.12 (median 1.99). The idle W of every block lies within 0.6 W (131.1-131.7 W).Checks
These ran locally after the rebase, and
claims_check,claims_check_test,ledger_drift_check,ledger_drift_check_testandpe_premise_checkran again with the same results after the log commit (d4ba6b6):tests/claims_check.sh: clean, 27 files.tests/claims_check_test.sh: 83 passed.python3 tests/ledger_drift_check.py: 42 files agree with 82 rows.tests/ledger_drift_check_test.py: OK, 34 tests.tests/pe_premise_check.sh: ok.bench/apb/test_h7x.py,test_stage.pyandtest_apb.py: OK.Crescent afterwards
sglang:num_requests_totalrose: :30000 went from 52 to 53, and :30001 from 46 to 47.