Skip to content

Tiered sensors: deterministic checks every change, inferential review at the end #250

Closed

Description

@vicgupta

Verify-before-stop currently recognises only tests and builds. Extend sensors to include linters, type checkers and structural checks, and separate them into two tiers:

  • Computational (fast, deterministic): lint/typecheck/test commands, configurable, runnable after edits and before stop.
  • Inferential (LLM review/judge): slower, run once at the end (reuse existing review).

Acceptance:

  • Config for a list of computational check commands (pass = exit 0), counted by verify-on-stop.
  • Clear ordering: cheap checks first, review last.
  • Off by default; existing behaviour unchanged. Tests with fake models. Docs updated.

Source: https://medium.com/@anubhavbhatt/harness-engineering-part-1-core-concepts-1db93ff995ec

Activity

  1. added
    amf:readyReady for amf to turn into a pull request
    and removed
    amf:readyReady for amf to turn into a pull request
    on Oct 30, 2026
  2. vicgupta commented on Oct 30, 2026

    @vicgupta
    OwnerAuthor

    Slice 1 is in #255: the computational tier (verify_on_stop.checks / --verify-check, run in order at stop, cheapest first, counted by verify-on-stop, verify.check JSON event, docs).

    Remaining work:

    • Inferential tier: optionally run the existing review (the --review uncommitted-changes flow) once at the end, only after every computational check passes, so ordering is cheap checks first and review last. Needs a config key/flag (off by default), a decision on how review findings feed back (re-prompt vs. report only), JSON event and docs.
  3. added a commit that references this issue on Oct 30, 2026
  4. added
    amf:readyReady for amf to turn into a pull request
    and removed
    amf:readyReady for amf to turn into a pull request
    on Oct 30, 2026
  5. added
    amf:doneamf opened a pull request for this issue
    and removed on Oct 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    amf:doneamf opened a pull request for this issue

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions