Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
275 changes: 138 additions & 137 deletions bench/suites/RESULTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,167 +6,168 @@ runner measured it; the suite runs `--no-parallelize-within-files`, so a
file's number is its own serial cost and is what an author adding a case
to it pays.

- suites: 159
- serial total: 1009.4s
- suites: 160
- serial total: 927.0s

| seconds | share | suite |
| ---: | ---: | --- |
| 140.6 | 13.9% | `tests/land-lock.bats` |
| 108.1 | 10.7% | `tests/derived-check.bats` |
| 102.2 | 10.1% | `tests/ci-wait.bats` |
| 83.1 | 8.2% | `tests/land.bats` |
| 54.5 | 5.4% | `tests/hooks-wiring-check.bats` |
| 36.1 | 3.6% | `tests/helpers.bats` |
| 35.9 | 3.6% | `tests/ci-local-parity.bats` |
| 34.4 | 3.4% | `tests/main-watch.bats` |
| 24.3 | 2.4% | `tests/hook-latency-drift.bats` |
| 23.7 | 2.3% | `tests/sbom-check.bats` |
| 17.4 | 1.7% | `tests/renovate-config-validator.bats` |
| 16.9 | 1.7% | `tests/claim-check.bats` |
| 13.2 | 1.3% | `tests/board-diff-overlap.bats` |
| 11.4 | 1.1% | `tests/config-lint.bats` |
| 10.2 | 1.0% | `tests/graph-check.bats` |
| 10.2 | 1.0% | `tests/prebuilt-lint.bats` |
| 9.5 | 0.9% | `tests/released.bats` |
| 9.0 | 0.9% | `tests/target-race.bats` |
| 8.9 | 0.9% | `tests/replay.bats` |
| 8.9 | 0.9% | `tests/board-write-record.bats` |
| 8.8 | 0.9% | `tests/run-shape-guard.bats` |
| 8.5 | 0.8% | `tests/token-bench.bats` |
| 8.3 | 0.8% | `tests/sbom.bats` |
| 7.5 | 0.7% | `tests/filed-here-check.bats` |
| 7.2 | 0.7% | `tests/ready-guard.bats` |
| 7.0 | 0.7% | `tests/mutant.bats` |
| 6.5 | 0.6% | `tests/perf-record.bats` |
| 6.4 | 0.6% | `tests/schema-check.bats` |
| 6.4 | 0.6% | `tests/mcp-allow-check.bats` |
| 6.3 | 0.6% | `tests/stop-guard.bats` |
| 5.9 | 0.6% | `tests/lock-complete.bats` |
| 5.9 | 0.6% | `tests/ready-lint.bats` |
| 5.8 | 0.6% | `tests/pkl-check.bats` |
| 5.4 | 0.5% | `tests/step-receipt.bats` |
| 5.1 | 0.5% | `tests/session-start.bats` |
| 5.0 | 0.5% | `tests/singleton.bats` |
| 4.6 | 0.5% | `tests/pre-commit-staging.bats` |
| 4.5 | 0.4% | `tests/in-progress-drain.bats` |
| 4.4 | 0.4% | `tests/release-assets-check.bats` |
| 4.0 | 0.4% | `tests/task-registry.bats` |
| 3.8 | 0.4% | `tests/board-move-guard.bats` |
| 3.7 | 0.4% | `tests/land-divergence.bats` |
| 3.6 | 0.4% | `tests/reference-check.bats` |
| 3.5 | 0.4% | `tests/doctor-race.bats` |
| 3.4 | 0.3% | `tests/ntia-check.bats` |
| 3.4 | 0.3% | `tests/target-ensure.bats` |
| 3.3 | 0.3% | `tests/semver.bats` |
| 3.2 | 0.3% | `tests/issue-read-check.bats` |
| 3.2 | 0.3% | `tests/with-lock.bats` |
| 2.7 | 0.3% | `tests/issue-read-guard.bats` |
| 2.7 | 0.3% | `tests/board-sweep.bats` |
| 2.7 | 0.3% | `tests/ready-cites-check.bats` |
| 2.4 | 0.2% | `tests/spawn-census.bats` |
| 2.4 | 0.2% | `tests/suite-select.bats` |
| 2.3 | 0.2% | `tests/hk-selection.bats` |
| 132.0 | 14.2% | `tests/land-lock.bats` |
| 102.0 | 11.0% | `tests/ci-wait.bats` |
| 97.7 | 10.5% | `tests/derived-check.bats` |
| 74.7 | 8.1% | `tests/land.bats` |
| 49.1 | 5.3% | `tests/hooks-wiring-check.bats` |
| 36.1 | 3.9% | `tests/helpers.bats` |
| 34.6 | 3.7% | `tests/main-watch.bats` |
| 34.3 | 3.7% | `tests/ci-local-parity.bats` |
| 24.2 | 2.6% | `tests/hook-latency-drift.bats` |
| 16.4 | 1.8% | `tests/claim-check.bats` |
| 16.3 | 1.8% | `tests/sbom-check.bats` |
| 15.4 | 1.7% | `tests/graph-check.bats` |
| 13.9 | 1.5% | `tests/board-diff-overlap.bats` |
| 12.1 | 1.3% | `tests/board-write-record.bats` |
| 10.2 | 1.1% | `tests/config-lint.bats` |
| 10.0 | 1.1% | `tests/prebuilt-lint.bats` |
| 8.3 | 0.9% | `tests/run-shape-guard.bats` |
| 7.4 | 0.8% | `tests/filed-here-check.bats` |
| 7.3 | 0.8% | `tests/token-bench.bats` |
| 7.3 | 0.8% | `tests/target-race.bats` |
| 6.9 | 0.7% | `tests/ready-guard.bats` |
| 6.9 | 0.7% | `tests/ready-lint.bats` |
| 6.8 | 0.7% | `tests/board-sweep.bats` |
| 6.4 | 0.7% | `tests/mutant.bats` |
| 5.8 | 0.6% | `tests/mcp-allow-check.bats` |
| 5.6 | 0.6% | `tests/renovate-config-validator.bats` |
| 5.4 | 0.6% | `tests/stop-guard.bats` |
| 5.2 | 0.6% | `tests/released.bats` |
| 5.1 | 0.5% | `tests/lock-complete.bats` |
| 4.9 | 0.5% | `tests/singleton.bats` |
| 4.9 | 0.5% | `tests/replay.bats` |
| 4.8 | 0.5% | `tests/session-start.bats` |
| 4.7 | 0.5% | `tests/sbom.bats` |
| 4.7 | 0.5% | `tests/step-receipt.bats` |
| 4.4 | 0.5% | `tests/pre-commit-staging.bats` |
| 4.2 | 0.5% | `tests/ready-cites-check.bats` |
| 4.0 | 0.4% | `tests/in-progress-drain.bats` |
| 3.9 | 0.4% | `tests/board-move-guard.bats` |
| 3.8 | 0.4% | `tests/task-registry.bats` |
| 3.8 | 0.4% | `tests/schema-check.bats` |
| 3.7 | 0.4% | `tests/release-assets-check.bats` |
| 3.4 | 0.4% | `tests/doctor-race.bats` |
| 3.4 | 0.4% | `tests/land-divergence.bats` |
| 3.2 | 0.4% | `tests/semver.bats` |
| 3.2 | 0.3% | `tests/ntia-check.bats` |
| 3.1 | 0.3% | `tests/issue-read-check.bats` |
| 3.0 | 0.3% | `tests/target-ensure.bats` |
| 3.0 | 0.3% | `tests/reference-check.bats` |
| 2.8 | 0.3% | `tests/with-lock.bats` |
| 2.6 | 0.3% | `tests/issue-read-guard.bats` |
| 2.5 | 0.3% | `tests/hk-selection.bats` |
| 2.3 | 0.2% | `tests/landed-check.bats` |
| 2.2 | 0.2% | `tests/fanout-guard.bats` |
| 2.1 | 0.2% | `tests/spec-ref-check.bats` |
| 2.1 | 0.2% | `tests/unlanded-check.bats` |
| 2.0 | 0.2% | `tests/claim-race-check.bats` |
| 2.0 | 0.2% | `tests/closing-key-check.bats` |
| 1.9 | 0.2% | `tests/run-shape.bats` |
| 1.8 | 0.2% | `tests/ci-slow-needed.bats` |
| 1.8 | 0.2% | `tests/finding-sink-check.bats` |
| 1.8 | 0.2% | `tests/signing-posture.bats` |
| 1.7 | 0.2% | `tests/tree-clean.bats` |
| 1.7 | 0.2% | `tests/skill-check.bats` |
| 1.7 | 0.2% | `tests/issue-search-guard.bats` |
| 1.7 | 0.2% | `tests/memories-check.bats` |
| 1.7 | 0.2% | `tests/reclaim-census.bats` |
| 1.6 | 0.2% | `tests/claimed-keys.bats` |
| 1.5 | 0.1% | `tests/ci-tools-check.bats` |
| 1.4 | 0.1% | `tests/bot-issue.bats` |
| 1.4 | 0.1% | `tests/mutant-census.bats` |
| 1.3 | 0.1% | `tests/verify.bats` |
| 1.2 | 0.1% | `tests/rules-drift.bats` |
| 1.2 | 0.1% | `tests/done-check.bats` |
| 1.2 | 0.1% | `tests/deferral-check.bats` |
| 1.2 | 0.1% | `tests/ci-lease-precondition.bats` |
| 1.2 | 0.1% | `tests/land-divergence-assert.bats` |
| 1.2 | 0.1% | `tests/ready-lint-deferral.bats` |
| 2.2 | 0.2% | `tests/claim-race-check.bats` |
| 2.1 | 0.2% | `tests/suite-select.bats` |
| 2.1 | 0.2% | `tests/closing-key-check.bats` |
| 2.0 | 0.2% | `tests/fanout-guard.bats` |
| 1.8 | 0.2% | `tests/bot-issue.bats` |
| 1.8 | 0.2% | `tests/unlanded-check.bats` |
| 1.7 | 0.2% | `tests/ci-slow-needed.bats` |
| 1.7 | 0.2% | `tests/spec-ref-check.bats` |
| 1.6 | 0.2% | `tests/ci-tools-check.bats` |
| 1.6 | 0.2% | `tests/issue-search-guard.bats` |
| 1.6 | 0.2% | `tests/skill-check.bats` |
| 1.6 | 0.2% | `tests/reclaim-census.bats` |
| 1.6 | 0.2% | `tests/finding-sink-check.bats` |
| 1.5 | 0.2% | `tests/tree-clean.bats` |
| 1.5 | 0.2% | `tests/claimed-keys.bats` |
| 1.4 | 0.2% | `tests/ci-lease-precondition.bats` |
| 1.4 | 0.2% | `tests/signing-posture.bats` |
| 1.3 | 0.1% | `tests/awk-regex-check.bats` |
| 1.3 | 0.1% | `tests/memories-check.bats` |
| 1.3 | 0.1% | `tests/run-shape.bats` |
| 1.3 | 0.1% | `tests/ready-lint-deferral.bats` |
| 1.2 | 0.1% | `tests/alive.bats` |
| 1.2 | 0.1% | `tests/verify.bats` |
| 1.1 | 0.1% | `tests/mutant-census.bats` |
| 1.1 | 0.1% | `tests/perf-record.bats` |
| 1.1 | 0.1% | `tests/linear-check.bats` |
| 1.1 | 0.1% | `tests/install-check.bats` |
| 1.0 | 0.1% | `tests/awk-regex-check.bats` |
| 1.0 | 0.1% | `tests/module-map-check.bats` |
| 1.0 | 0.1% | `tests/alive.bats` |
| 1.0 | 0.1% | `tests/nonverdict-scan.bats` |
| 0.9 | 0.1% | `tests/target-prune.bats` |
| 0.9 | 0.1% | `tests/perf-assert.bats` |
| 0.9 | 0.1% | `tests/hook-pin-check.bats` |
| 0.9 | 0.1% | `tests/evaluator-closure-check.bats` |
| 0.8 | 0.1% | `tests/gh-guard.bats` |
| 0.8 | 0.1% | `tests/release-tracking-check.bats` |
| 0.8 | 0.1% | `tests/prose-only-check.bats` |
| 1.1 | 0.1% | `tests/deferral-check.bats` |
| 1.0 | 0.1% | `tests/spawn-census.bats` |
| 1.0 | 0.1% | `tests/done-check.bats` |
| 0.9 | 0.1% | `tests/install-check.bats` |
| 0.9 | 0.1% | `tests/nonverdict-scan.bats` |
| 0.9 | 0.1% | `tests/land-divergence-assert.bats` |
| 0.9 | 0.1% | `tests/rules-drift.bats` |
| 0.9 | 0.1% | `tests/attestation-check.bats` |
| 0.9 | 0.1% | `tests/checks-green.bats` |
| 0.8 | 0.1% | `tests/perf-assert.bats` |
| 0.8 | 0.1% | `tests/module-map-check.bats` |
| 0.8 | 0.1% | `tests/hook-pin-check.bats` |
| 0.8 | 0.1% | `tests/issue-search-check.bats` |
| 0.8 | 0.1% | `tests/attestation-check.bats` |
| 0.8 | 0.1% | `tests/doctor.bats` |
| 0.8 | 0.1% | `tests/done-pr-check.bats` |
| 0.8 | 0.1% | `tests/pr-unsubscribed.bats` |
| 0.7 | 0.1% | `tests/gh-guard.bats` |
| 0.7 | 0.1% | `tests/target-prune.bats` |
| 0.7 | 0.1% | `tests/prose-only-check.bats` |
| 0.7 | 0.1% | `tests/sbom-binary.bats` |
| 0.7 | 0.1% | `tests/doctor.bats` |
| 0.7 | 0.1% | `tests/release-tracking-check.bats` |
| 0.7 | 0.1% | `tests/pr-unsubscribed.bats` |
| 0.7 | 0.1% | `tests/render-cli.bats` |
| 0.7 | 0.1% | `tests/timeout-drift.bats` |
| 0.7 | 0.1% | `tests/sbom-binary.bats` |
| 0.7 | 0.1% | `tests/hook-matcher-check.bats` |
| 0.7 | 0.1% | `tests/checks-green.bats` |
| 0.7 | 0.1% | `tests/merged-pr-keys.bats` |
| 0.6 | 0.1% | `tests/perf-compare.bats` |
| 0.6 | 0.1% | `tests/install.bats` |
| 0.6 | 0.1% | `tests/mcp-timeout-budget.bats` |
| 0.6 | 0.1% | `tests/stop-posture-check.bats` |
| 0.6 | 0.1% | `tests/verified.bats` |
| 0.7 | 0.1% | `tests/duplicate-close-check.bats` |
| 0.6 | 0.1% | `tests/hook-matcher-check.bats` |
| 0.6 | 0.1% | `tests/evaluator-closure-check.bats` |
| 0.6 | 0.1% | `tests/mcp-attach-check.bats` |
| 0.6 | 0.1% | `tests/connector-verb-guard.bats` |
| 0.5 | 0.1% | `tests/hook-profile-check.bats` |
| 0.6 | 0.1% | `tests/checksums.bats` |
| 0.6 | 0.1% | `tests/mcp-timeout-budget.bats` |
| 0.6 | 0.1% | `tests/perf-compare.bats` |
| 0.6 | 0.1% | `tests/merged-pr-keys.bats` |
| 0.6 | 0.1% | `tests/hook-profile-check.bats` |
| 0.5 | 0.1% | `tests/verified.bats` |
| 0.5 | 0.1% | `tests/install.bats` |
| 0.5 | 0.1% | `tests/stop-posture-check.bats` |
| 0.5 | 0.1% | `tests/connector-verb-guard.bats` |
| 0.5 | 0.1% | `tests/branch-age-check.bats` |
| 0.5 | 0.1% | `tests/abandon-matrix.bats` |
| 0.5 | 0.0% | `tests/macos-link-check.bats` |
| 0.5 | 0.0% | `tests/publish-credential-check.bats` |
| 0.5 | 0.0% | `tests/pipefail-grep-check.bats` |
| 0.5 | 0.0% | `tests/checksums.bats` |
| 0.5 | 0.0% | `tests/land-lock-check.bats` |
| 0.5 | 0.0% | `tests/digest-major-agreement.bats` |
| 0.4 | 0.0% | `tests/publish-credential-check.bats` |
| 0.4 | 0.0% | `tests/land-lock-check.bats` |
| 0.4 | 0.0% | `tests/digest-major-agreement.bats` |
| 0.4 | 0.0% | `tests/pipefail-grep-check.bats` |
| 0.4 | 0.0% | `tests/msrv-pin-agreement.bats` |
| 0.4 | 0.0% | `tests/license-table-check.bats` |
| 0.4 | 0.0% | `tests/sonar-gate.bats` |
| 0.4 | 0.0% | `tests/connector-allow-guard.bats` |
| 0.4 | 0.0% | `tests/run-shape-guard-quoting.bats` |
| 0.4 | 0.0% | `tests/commit-convention.bats` |
| 0.4 | 0.0% | `tests/suite-bench-check.bats` |
| 0.4 | 0.0% | `tests/abandon-matrix.bats` |
| 0.4 | 0.0% | `tests/serena-mcp.bats` |
| 0.4 | 0.0% | `tests/branch-age-check.bats` |
| 0.4 | 0.0% | `tests/transcript-corpus-check.bats` |
| 0.3 | 0.0% | `tests/release-due.bats` |
| 0.3 | 0.0% | `tests/board-payloads.bats` |
| 0.4 | 0.0% | `tests/cap-drift.bats` |
| 0.4 | 0.0% | `tests/board-payloads.bats` |
| 0.4 | 0.0% | `tests/batten-glob-check.bats` |
| 0.3 | 0.0% | `tests/serena-mcp.bats` |
| 0.3 | 0.0% | `tests/run-shape-guard-quoting.bats` |
| 0.3 | 0.0% | `tests/transcript-corpus-check.bats` |
| 0.3 | 0.0% | `tests/timeout-check.bats` |
| 0.3 | 0.0% | `tests/no-doctests.bats` |
| 0.3 | 0.0% | `tests/release-due.bats` |
| 0.3 | 0.0% | `tests/pkl-check.bats` |
| 0.3 | 0.0% | `tests/ci-drift.bats` |
| 0.3 | 0.0% | `tests/nonverdict-assert.bats` |
| 0.3 | 0.0% | `tests/commit-convention.bats` |
| 0.3 | 0.0% | `tests/suite-bench-check.bats` |
| 0.3 | 0.0% | `tests/commit-attribution.bats` |
| 0.3 | 0.0% | `tests/report-only-check.bats` |
| 0.3 | 0.0% | `tests/no-doctests.bats` |
| 0.3 | 0.0% | `tests/cap-drift.bats` |
| 0.3 | 0.0% | `tests/license-table-check.bats` |
| 0.3 | 0.0% | `tests/connector-allow-resolve.bats` |
| 0.3 | 0.0% | `tests/container-preflight.bats` |
| 0.3 | 0.0% | `tests/mise-action-floor.bats` |
| 0.3 | 0.0% | `tests/commit-attribution.bats` |
| 0.3 | 0.0% | `tests/ci-drift.bats` |
| 0.3 | 0.0% | `tests/connector-allow-resolve.bats` |
| 0.2 | 0.0% | `tests/coderabbit-config-check.bats` |
| 0.2 | 0.0% | `tests/mise-pin-agreement.bats` |
| 0.2 | 0.0% | `tests/batten-glob-check.bats` |
| 0.2 | 0.0% | `tests/rust-paths-check.bats` |
| 0.2 | 0.0% | `tests/coderabbit-config-check.bats` |
| 0.2 | 0.0% | `tests/git-hook.bats` |
| 0.2 | 0.0% | `tests/perf-gate.bats` |
| 0.2 | 0.0% | `tests/mise-action-floor.bats` |
| 0.2 | 0.0% | `tests/token-bench-check.bats` |
| 0.2 | 0.0% | `tests/task-fail-closed.bats` |
| 0.2 | 0.0% | `tests/evaluator-io-check.bats` |
| 0.2 | 0.0% | `tests/remedy-payload-source.bats` |
| 0.2 | 0.0% | `tests/perf-gate.bats` |
| 0.1 | 0.0% | `tests/dist.bats` |
| 0.1 | 0.0% | `tests/task-fail-closed.bats` |
| 0.1 | 0.0% | `tests/test-bats-parallel.bats` |
| 0.1 | 0.0% | `tests/remedy-payload-source.bats` |
| 0.1 | 0.0% | `tests/perf-pair.bats` |
| 0.1 | 0.0% | `tests/evaluator-io-check.bats` |
| 0.1 | 0.0% | `tests/egress-check.bats` |
| 0.1 | 0.0% | `tests/darwin-link.bats` |
| 0.1 | 0.0% | `tests/perf-pair.bats` |
| 0.1 | 0.0% | `tests/cross-check.bats` |
| 0.1 | 0.0% | `tests/darwin-link.bats` |
| 0.0 | 0.0% | `tests/zizmor-split.bats` |
Loading
Loading