Skip to content

fix(accounts): test Claude accounts on Sonnet 5.5, then Opus 5.5, by default - #226

Merged
HTExplicit merged 1 commit into
mainfrom
fix/claude-test-default
Oct 2, 2026
Merged

HTExplicit merged 1 commit into
mainfrom
fix/claude-test-default

Conversation

@HTExplicit

Copy link
Copy Markdown
Owner

Problem

After #224, Anthropic accounts still opened the test dialog with no reasoning-effort select. Every Anthropic account's default test model was claude-sonnet-4-5-20250929, and that model accepts no output_config.effort, so the select stays hidden until the admin switches models.

Anthropic deprecated claude-sonnet-4-5-20250929 on 2026-09-30 and will retire it on 2026-11-30. Its named replacement is claude-sonnet-5-5.

Change

  • Default test model: claude.DefaultTestModel is now claude-sonnet-5-5, with the new claude.DefaultTestModelFallback = claude-opus-5-5 as fallback.
  • Model choice: PickConnectionTestModel walks the platform's ordered defaults (Sonnet 5.5, then Opus 5.5 for Anthropic and CN-Anthropic) before falling back to the first text model of the account's list.
  • Stable list order: Anthropic and Gemini API-key test model lists are built from mapping keys in a stable (sorted) order, as Grok already was. The fallback no longer depends on Go map iteration.
  • Batch tests: the same choice applies to batch tests that name no model.

Owner decision 2026-10-02: Sonnet 5.5, then Opus 5.5, then the first text model in a stable order. The select stays hidden for models without effort support.

Verification

Run locally:

  • gofmt, go build ./..., and go vet on the changed packages;
  • TestPickConnectionTestModelPrefersClaudeTestModelsInOrder;
  • TestAccountTestPlanAnthropicDefaultFollowsTestModelPreference;
  • plus the existing plan tests TestAccountTestPlanCoreSelectionSmallMatrix and TestAccountTestModelsCarryReasoningOnEveryPlatform.

Not run: real model calls.

🤖 Generated with Claude Code

…default

The default Claude test model was claude-sonnet-4-5-20250929, which
Anthropic deprecated on 2026-09-30 (retiring 2026-11-30) and which accepts
no reasoning effort, so the test dialog of every Anthropic account opened
on a model without the effort select. Connection tests now prefer
claude-sonnet-5-5 (Anthropic's named replacement), then claude-opus-5-5,
and otherwise the first text model of the account's list. That list is now
built from mapping keys in a stable order for Anthropic and Gemini API-key
accounts, so the fallback no longer depends on map iteration. The same
choice applies to batch tests that name no model. Owner decision 2026-10-02.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@HTExplicit
HTExplicit merged commit c41ba2d into main Oct 2, 2026
18 checks passed
@HTExplicit
HTExplicit deleted the fix/claude-test-default branch October 2, 2026 13:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant