Skip to content

Document how to run and interpret XRay benchmarks - #3

Open
jimsweeney wants to merge 4 commits into
NVIDIA:mainfrom
jimsweeney:xray-lp-benchmarks
Open

jimsweeney wants to merge 4 commits into
NVIDIA:mainfrom
jimsweeney:xray-lp-benchmarks

Conversation

@jimsweeney

@jimsweeney jimsweeney commented Sep 16, 2026 •

Copy link
Copy Markdown

Documents how to run and interpret the existing XRay P1, P2, and Savitzky–Golay benchmarks. The guide explains timing boundaries, numerical checks, CPU/GPU ratio denominators, and environment provenance so users can assess a run. It documents the versioned CuPy eigensolver limitation and identifies matrix-pencil/ESPRIT as experimental alternatives.

Validated after refreshing onto current main: all three documented CPU commands and both subspace help commands passed; 12 documentation/schema tests, the full CPU suite (2,787 passed; 210 skipped), and make ci-lint passed. GPU benchmarks were not rerun.

Historical contributor measurements

The original measurements and profiling observations remain in the original benchmark note. They describe revision 9e91835 on one RTX 4050 Laptop GPU under WSL2. The profiling script/raw outputs were not retained, and the original P1 component count is uncertain. Fresh, reproducible measurements are needed for release performance baselines.

Refs #1.

@coderabbitai

coderabbitai Bot commented Sep 24, 2026 •

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are limited based on label configuration.

🏷️ Required labels (at least one): 1
  • ai-review

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration
  • Configuration used: Repository: NVIDIA/cuPhoton/.coderabbit.yaml
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: a10eb41e-85e4-4875-b9cc-6f0310258827

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

@tpn

tpn commented Sep 25, 2026

Copy link
Copy Markdown
Collaborator

@coderabbitai full review

@coderabbitai

coderabbitai Bot commented Sep 25, 2026 •

Copy link
Copy Markdown
⚠️ Action not completed

Review rate limited.

@tpn
tpn force-pushed the xray-lp-benchmarks branch 2 times, most recently from cdfec02 to 1dca43e Compare September 28, 2026 22:11
@copy-pr-bot

copy-pr-bot Bot commented Sep 28, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@tpn
tpn force-pushed the xray-lp-benchmarks branch from 1dca43e to 574371f Compare October 1, 2026 01:41
@tpn

tpn commented Oct 1, 2026

Copy link
Copy Markdown
Collaborator

/ok to test 574371f

@tpn
tpn force-pushed the xray-lp-benchmarks branch 3 times, most recently from 4cebcfa to 7fa7efc Compare October 9, 2026 20:44
@tpn
tpn changed the base branch from main to codex/ci-python-ecr-20261009 October 9, 2026 21:07
@tpn
tpn force-pushed the xray-lp-benchmarks branch from 7fa7efc to af7a389 Compare October 9, 2026 21:08
@melo-gonzo

Copy link
Copy Markdown
Collaborator

The documented commands work, and the timing notes match the benchmark code. No issues found in this revision. This documentation looks ready to merge.

@tpn
tpn force-pushed the xray-lp-benchmarks branch from af7a389 to d2b9894 Compare October 15, 2026 18:05
@tpn
tpn changed the base branch from codex/ci-python-ecr-20261009 to main October 15, 2026 18:06
jimsweeney and others added 4 commits October 16, 2026 11:44
docs/xray/LINEAR-PREDICTION-BENCHMARKS.md records how lpb, lppb and lpsb
measure (transfers excluded, warm-up call, null-stream synchronisation,
best of --repeat), the reproduction commands, and the numbers on an RTX
4050 Laptop GPU under WSL2 with CUDA 13.2 and CuPy 14.1.1, together with
a profile of where the P1 GPU time goes: cusolver xgeev is called once
per 71 x 71 companion matrix even on the batched path, so batching buys
2 to 10 percent and the CPU is 15x faster at 96 samples. Linked from the
xray README. No code changes.

Refs NVIDIA#1

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014wyj5iPSHmtR3vSTvJWKfw
Signed-off-by: James Sweeney <jmsweene@gmail.com>
Signed-off-by: Trent Nelson <trentn@nvidia.com>
Describe row variation, CPU batching and timed scalar transfers.
State the missing component-order and profiling provenance without
changing the contributed timing observations.

Signed-off-by: Trent Nelson <trentn@nvidia.com>
Explain timing boundaries, CPU and GPU comparisons, and numerical
checks for the existing benchmark commands. Keep machine measurements
as review evidence and describe the versioned eigensolver limitation.

Signed-off-by: Trent Nelson <trentn@nvidia.com>
Signed-off-by: Trent Nelson <trentn@nvidia.com>
@tpn
tpn force-pushed the xray-lp-benchmarks branch from d2b9894 to f1cf2e8 Compare October 16, 2026 18:47

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants