Skip to content

Rebuild summaries whenever the add-models box is ticked - #99

Merged
nojibe merged 1 commit into
mainfrom
claude/rebuild-always
Oct 1, 2026
Merged

nojibe merged 1 commit into
mainfrom
claude/rebuild-always

Conversation

@nojibe

@nojibe nojibe commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Summary

The add-models job only rebuilt the homepage, leaderboards and model summaries when it had added a model to at least one blueprint. After runs changed in other ways, such as re-judging, there was no way to republish them from GitHub. Now, ticking rebuild_summaries always rebuilds at the end, even when every blueprint was skipped.

Changes

  • src/app/api/internal/add-models-to-runs/route.ts: rebuild when rebuildSummaries is set, regardless of how many blueprints were added.
  • The workflow input description now says it rebuilds even if nothing changed.
  • Route tests: the "skips the rebuild when nothing was added" test now expects a rebuild when asked, and a new test checks there's no rebuild unless asked.

Test plan

  • Route tests: 10 pass.
  • Full suite: 1176 passed, 2 skipped. tsc --noEmit is clean.
  • After merge: run Add Models To Runs for an already-done blueprint with rebuild_summaries ticked, and check the logs show "Summaries rebuilt."

Risks

Each workflow run with the box ticked (the default) now always spends a rebuild, about 15 minutes of server time, even when nothing changed.

🤖 Generated with Claude Code

https://claude.ai/code/session_015roAwvpcszBvjX1Ce5NFuj


Generated by Claude Code

The job only rebuilt the homepage, leaderboards and model summaries when it
had added a model somewhere, so there was no way to republish them after
runs changed by other means. Ticking rebuild_summaries now always rebuilds
at the end, even when every blueprint was skipped.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015roAwvpcszBvjX1Ce5NFuj

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review for a one-time review, or @claude review always to subscribe this PR to a review on every future push.

Tip: disable this comment in your organization's Code Review settings.

@railway-app
railway-app Bot temporarily deployed to weval / app-pr-99 October 1, 2026 16:04 Destroyed
@railway-app

railway-app Bot commented Oct 1, 2026 •

Copy link
Copy Markdown
Contributor

🚅 Deployed to the app-pr-99 environment in weval

Service Status Web Updated
weval-app ✅ Success (View Logs) Web Oct 1, 2026 at 4:13 pm UTC

@nojibe
nojibe merged commit 53ab3f9 into main Oct 1, 2026
2 checks passed

This branch was successfully deployed

No deployments
weval / app-pr-99 — 71f4cda9 Deployed Oct 1, 2026 by railway-app[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants