Skip to content

ci: skip review bots on documentation-only PRs - #68

Merged
flowcool merged 2 commits into
playwright-nextfrom
ci/cost-reduction
Oct 27, 2026
Merged

flowcool merged 2 commits into
playwright-nextfrom
ci/cost-reduction

Conversation

@flowcool

Copy link
Copy Markdown
Owner

Behavior

Review bots reviewed documentation-only PRs, and the PR template asked agents to request a CodeRabbit review by hand on every PR, although Pullfrog is the sole reviewer and CodeRabbit is ignored.

  • pullfrog.yml: a local step skips the agent for documentation-only PRs (docs/, openspec/, *.md; PR number from the run name). Fails open.
  • .coderabbit.yaml: documentation filtered by path and by docs:/docs( titles.
  • PR template: Pullfrog section replaces the manual CodeRabbit request.

assurance.yml is unchanged on purpose: its push on playwright-next publishes the image, concurrency already cancels superseded PR runs, the ruleset already requires up-to-date branches, and open PRs #49 and #66 edit that file.

Same Pullfrog gate as flowcool/ghostfolio-ibkr-sync#324 (merged).

Verification

  • Command: actionlint 1.7.12 .github/workflows/pullfrog.yml; YAML parse of .coderabbit.yaml; docs-only detection snippet on synthetic file lists.
  • Expected result: no finding; docs-only lists → skip, any code file or empty list → review runs.
  • Observed result: actionlint rc=0; YAML OK; detection as expected.

Use synthetic credentials and isolated state. Do not attach private logs, browser
profiles, screenshots containing credentials, or downloaded customer documents.

AI assistance

Prepared by Claude Code (Opus 5.5); skip behavior on a real documentation-only PR is verified after merge.

Pullfrog review

Pullfrog is the sole reviewer. Require a completed review of the final head,
resolve actionable threads and keep all CI checks green. Ignore CodeRabbit and
the known sticky pullfrog-approval status only. Documentation-only PRs
(docs/, openspec/, *.md) need CI only.

Review evidence:

🤖 Generated with Claude Code

https://claude.ai/code/session_01EQXdcx49Pi5uQErd6kDEKs

- Pullfrog skips documentation-only PRs (docs/, openspec/, *.md); fails open.
- CodeRabbit filters documentation by path and docs: titles.
- PR template: Pullfrog is the sole reviewer; agents no longer request
  CodeRabbit reviews by hand.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01EQXdcx49Pi5uQErd6kDEKs
@coderabbitai

coderabbitai Bot commented Oct 27, 2026 •

Copy link
Copy Markdown

Important

  • 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

Run configuration
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@pullfrog pullfrog Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Important

The gate stops the action from running. But the Pullfrog app creates its progress comment and the pullfrog check run before the workflow starts, and only the action finishes them. On documentation-only PRs, both are likely to stay stuck as "running". Please confirm how this behaves before merging.

Reviewed changes

I reviewed the full diff: three CI/config files, no application code.

  • Pullfrog documentation-only gate: a new scope step takes the PR number from inputs.name and lists files with gh pr diff --name-only. If every file matches docs/, openspec/ or *.md, it skips checkout and the agent. I checked the run-name regex against real run titles (Review #68 [dqsez], Review new commits on #67 [er65f]). Mention and fix runs don't match it, so they still run. Every failure path falls back to running the review.
  • CodeRabbit filters: adds auto_review.ignore_title_keywords and reviews.path_filters. The keys are valid and sit in the right place in the v2 schema.
  • PR template: replaces the manual CodeRabbit request checklist with a short Pullfrog section.

Pullfrog  | Fix all ➔ | Fix 👍s ➔ | View workflow run | Using claude-opus-5-5 | 𝕏

Comment thread .github/workflows/pullfrog.yml Resolved
Comment thread .github/workflows/pullfrog.yml Resolved
…nfra-t4jxa)

Documentation-only means only *.md files (docs/ and openspec/ do not exist
here); doc/ assets keep a Pullfrog review, matching the shared pr-gate rule.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01EQXdcx49Pi5uQErd6kDEKs
@flowcool

Copy link
Copy Markdown
Owner Author

@pullfrog please post a review of the final head c43450b (wording-only delta since your review of 4d8ac56); the merge gate requires a review object on the exact head.

@pullfrog pullfrog Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ No new issues found.

Reviewed changes

Since the prior review of 4d8ac56, only comment and template wording changed. The matcher logic did not change.

  • Clarified the pullfrog.yml gate comment: it now says the matcher follows the shared pr-gate docs-only rule (*.md, docs/, openspec/) and that doc/ assets still get a review. That matches the unchanged grep -qvE '^(docs/|openspec/)|\.md$' expression.
  • Narrowed the PR template wording: the template now says PRs that change only *.md files need CI only. That is correct for this repo, where docs/ and openspec/ don't exist.

Both earlier threads are resolved. The wording thread was fixed in c43450b. The thread about the unfinished pullfrog check run was accepted as a trade-off: pr-gate ignores that check when no review is required.

Pullfrog  | View workflow run | Using claude-opus-5-5 | 𝕏

@flowcool
flowcool merged commit 83ae2de into playwright-next Oct 27, 2026
11 checks passed
@flowcool
flowcool deleted the ci/cost-reduction branch October 27, 2026 22:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant