Skip to content

Add vdt guide and vdt explain, and slim the agent skill - #28

Merged
c5inco merged 2 commits into
mainfrom
t3code/vdt-guide
Nov 2, 2026
Merged

c5inco merged 2 commits into
mainfrom
t3code/vdt-guide

Conversation

@c5inco

@c5inco c5inco commented Nov 2, 2026

Copy link
Copy Markdown
Owner

Moves the agent guidance out of a 226-line skill and into the binary, following cav's guide concept. Guidance built into the binary always matches the installed version, and any agent that can run a shell command can read it.

Changes

  • vdt guide [topic] prints the workflow (inspect, fix, generate, wire up) and pages for adaptive, notification, drawables, diagnostics, and ci. The source is markdown in src/guide/, compiled in with include_str!.
  • vdt explain <code> explains a diagnostic code such as VDT019 in depth. With no code, it lists all 26. It accepts VDT019, vdt019, or 19.
  • vdt --help now ends with a pointer to both.
  • skills/vdt/SKILL.md is now about 40 lines: install check, "run vdt guide", and the agent rules (inspect first, ask before changing artwork, never hand-edit output).
  • tests/skill.rs now fails when a guide page or the skill names a command, flag, or vdt guide topic that doesn't exist, or when a DiagnosticCode has no explain entry.
  • tools/eval-guide/ is the eval below: a fixture project, setup.sh, grade.py, and the results.

Eval

Four agents each ran under three conditions. The task was a launcher icon, a notification icon, and an illustration that can't be converted without changing the artwork. Scores are out of 16.

Long skill (old binary) Thin skill + guide No skill (guide binary)
Claude Sonnet 5.5 14 16 15
Codex GPT-6.1 Sol 14.75 16 16
Grok 4.7 16 16 16
Gemini Pro (Pi) 14.75 16 16
Mean 14.9 16.0 15.75
  • Long-skill misses: every one is covered by the guide. They were a missing themed layer, the default fit on edge-to-edge notification art, code pointing at a drawable that doesn't exist, and an incomplete report.
  • No skill: every agent found vdt guide through the --help hint and read it.
  • Cost: guide runs make more vdt calls (18–20 vs 11.5 on average). Token use wasn't measured.
  • Caveats: one fixture and one run per cell, so treat the results as indicative.

Found by the eval

The old skill told agents to ask before deleting template launcher bitmaps. In fact adaptive --legacy replaces them itself, on purpose, so they can't outrank the legacy icon on API 21–25. The guide now describes what actually happens and the --name way to keep them. Separately, a logo on an opaque tile becomes a solid shape as a themed icon. The guide now says so; a vdt warning for it would be a worthwhile follow-up.

Testing

cargo fmt --check, cargo clippy --all-targets -- -D warnings, and cargo test all pass.

🤖 Generated with Claude Code

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Nov 2, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-11-02T04:13:50.058296Z 96d9d30 Manual request
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@c5inco

c5inco commented Nov 2, 2026

Copy link
Copy Markdown
Owner Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. You're on a roll.

Reviewed commit: a743cb6b54

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

c5inco and others added 2 commits November 1, 2026 20:10
Usage guidance now ships in the binary, so it always matches the installed
version and any agent that can run a shell command can read it.

- `vdt guide [topic]` prints the workflow and pages for adaptive,
  notification, drawables, diagnostics, and ci.
- `vdt explain <code>` explains a diagnostic code in depth; `vdt explain`
  lists all 26. `vdt --help` points to both.
- skills/vdt/SKILL.md shrinks from 226 lines to an entry point that sends
  the agent to `vdt guide` and keeps the rules about artwork and resources.
- tests/skill.rs now also fails when a guide page names a command, flag, or
  topic vdt does not have, or a diagnostic code has no explanation.

The old skill told agents to ask before deleting template launcher bitmaps,
but `adaptive --legacy` replaces them itself; the guide describes what it
actually does.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
tools/eval-guide sets up one Android project per agent and condition (long
skill with the baseline binary, thin skill with vdt guide, or no skill),
logs every vdt command, and grades the result. Four agents scored a mean of
14.9/16 with the long skill, 16.0 with the thin skill and guide, and 15.75
with no skill. Reports and command logs from that run are in results/.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@c5inco

c5inco commented Nov 2, 2026

Copy link
Copy Markdown
Owner Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Breezy!

Reviewed commit: 96d9d30d07

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@c5inco
c5inco merged commit 1be217c into main Nov 2, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant