Skip to content

docs: Explain how to find values that change between runs - #35

Merged
dcramer merged 1 commit into
mainfrom
docs/find-changing-values
Nov 5, 2026
Merged

dcramer merged 1 commit into
mainfrom
docs/find-changing-values

Conversation

@sentry-junior

@sentry-junior sentry-junior Bot commented Nov 5, 2026

Copy link
Copy Markdown
Contributor

A value that changes on each run and that no pattern finds gives a new key on each run. The request goes live and records again every time, and no error shows it. Warden hit this with its random finding ids (getsentry/warden#564): e2e and security-review tests stayed partly live on every CI run while the tests passed.

This adds a "Find changing values" section to the README:

  • The check to do after setup: run two times, and live on the second run must be about 0.
  • How to find the first miss (ROACH_MODE=replay, no token).
  • A local-only vitest setup file that writes each fetch request body, so you can diff two runs. Recordings do not keep request bodies.
  • Values found so far: generated ids, temp paths, commit SHAs, times, local env (global git config and hooks, HOME, locale), and array order.

"Use with vitest" and TELEMETRY.md link to the section.

The snippet was checked in Node 24 with a string body, a Request input, and a GET.

Docs only. No release needed.

via @dcramer.

--

View Session [Sentry]

A value that changes on each run and that no pattern finds makes a request
go live on every run, with no error. Add the check to do after setup, a way
to capture request bodies to compare, and the sources found in Warden.

Co-Authored-By: David Cramer <23610+dcramer@users.noreply.github.com>
@dcramer
dcramer merged commit 435d003 into main Nov 5, 2026
16 checks passed
@sentry-junior
sentry-junior Bot deleted the docs/find-changing-values branch November 5, 2026 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant