Skip to content

Say how the site gets the decode mode of the older rows - #7

Open
devYRPauli wants to merge 1 commit into
mainfrom
fix/pr1-codex-quirk-flags
Open

devYRPauli wants to merge 1 commit into
mainfrom
fix/pr1-codex-quirk-flags

Conversation

@devYRPauli

Copy link
Copy Markdown
Owner

Problem

Amendment 8 of the design spec says that every result records its decode side in server.quirk_flags. It also says that an empty flag set means unverified. On main, the 12 llama.cpp rows and the 14 Ollama rows have empty server.quirk_flags and decode_mode: "unknown". Under that rule, a reader classifies 26 of the 32 rows as unverified.

registry/decode-modes-v1.json cites this section (lines 248 to 267) as a source of its three preset mappings. The site links that registry as the "cited preset mapping". The Codex review on #1 flagged the same claim in the README. #2 rewrote the README, but the spec kept the claim.

Fix

Rewrite the five lines of the DECIDED bullet in place. The bullet now says:

  • The site shows the decode mode of each row.
  • Schema v3 can record the mode in server.decode_mode.
  • The site reads the mode of the older Ollama and llama.cpp rows from registry/decode-modes-v1.json.
  • An unmapped preset stays unknown.

This matches the README and the M7 spec. The file keeps its line count, so the registry citation still points at lines 248 to 267.

Testing

  • cargo run -q -p willitcall -- site --results results/ --out <dir> on main generates 32 rows. index.html shows "documented preset mapping" for the 12 llama.cpp rows and the 14 Ollama rows. It shows "recorded by run" for the 6 mlx-lm rows.
  • cargo test --workspace: 155 tests pass.
  • No code or test reads the spec. git grep finds its path only in registry/decode-modes-v1.json.

Amendment 8 of the design spec said that every result records its
decode side in server.quirk_flags, and that an empty flag set means
unverified. The 12 llama.cpp and 14 Ollama rows on main have empty
flags and decode_mode "unknown". The site reads their mode from
registry/decode-modes-v1.json, and that registry cites this section.

Say what M7 does: schema v3 can record server.decode_mode, the site
reads the older rows from the preset mapping, and an unmapped preset
stays unknown. The README already says this.

The design spec keeps its line count, so lines 248 to 267 stay in
place.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant