Skip to content

docs: record the first performance baseline measured on this box - #2586

Merged
Birfy merged 1 commit into
mainfrom
docs/perf-baseline-2585
Nov 7, 2026
Merged

Birfy merged 1 commit into
mainfrom
docs/perf-baseline-2585

Conversation

@Birfy

@Birfy Birfy commented Nov 7, 2026 •

Copy link
Copy Markdown
Collaborator

Fixes #2585

Owner: Dev
Reviewer: Reviewer

The first-baseline section said Not measured — this host cannot build the deepseek-harness checkout, and its table was all —. Both halves of that blocker are gone (#2571 for the bench, #2577 for the script default message), so this replaces the placeholder with the table the script actually prints.

What changed: docs/performance-baseline.md only — the placeholder paragraph and its "table to fill" block are replaced by the measured table plus the machine / commit / node / date line, and the earlier different-prompt run is kept as a one-line reference so nobody compares two prompts as one series.

Ran at this tip: core/dev/bench.sh perf 3098 8798 reset → PERF_COMMIT=87b2e08b… node dev/perf-baseline.mjs perf 3098 --out /tmp/perf87b2.json → exit 0, 20/20 measured turns each produced a tool call → dev/bench.sh perf 3098 8798 stop. No test suite is affected by a docs-only change; node .github/scripts/changelog.mjs check not needed (no fragment, docs-only).

Docs-not-needed: docs/performance-baseline.md is the document being corrected; no subsystem page owns it and no source path changes.

Checkpoint

{
"pr": 2586,
"claim": "Dev",
"issue": 2585,
"summary": "Replaces the "not measured" placeholder in docs/performance-baseline.md with the baseline the bench now prints: 20-turn table for turn latency, tool-call latency, resident RSS and plugin load, plus the machine, commit, node and date line. The earlier different-prompt run stays as one reference line so two prompts are not read as one series. Docs only: no code, no threshold, no gate.",
"files": [
"docs/performance-baseline.md"
],
"checks": {
"ran": "core/dev/bench.sh perf 3098 8798 reset; PERF_COMMIT=87b2e08b node dev/perf-baseline.mjs perf 3098 --out /tmp/perf87b2.json; dev/bench.sh perf 3098 8798 stop",
"result": "green",
"at": "bf359c857eb1f056b173f9a755877d560e349131"
},
"next": "none — ready for review"
}

@Birfy Birfy added agent-pr Pull request opened by an agent area:docs Documentation documentation Improvements or additions to documentation labels Nov 7, 2026
@Birfy Birfy self-assigned this Nov 7, 2026
@Birfy
Birfy added this pull request to the merge queue Nov 7, 2026
Merged via the queue into main with commit 45f52b3 Nov 7, 2026
15 of 17 checks passed
@Birfy
Birfy deleted the docs/perf-baseline-2585 branch November 7, 2026 07:35
@github-actions github-actions Bot removed the agent-pr Pull request opened by an agent label Nov 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:docs Documentation documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

docs: fill the first performance baseline the table still marks as not measured

1 participant