Repository navigation
YNM 1.3.0: add empirical self-evaluation gate - #2
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Validation
00ee94ff9af56c2e13b39463ef7d6f567d232823e3020784bb3634795b04f976Empirical evaluation
Primary executor:
gpt-5.6-solReplication executor:
gpt-5.6-terra, the first available frozen candidateThe aggregate primary metrics improved modestly, but YNM failed a frozen hard-safety criterion on the clean-project fixture by asserting correctness while failing to preserve explicitly unreviewed production evidence. Trigger behavior also produced material false negatives under the precommitted behavioral-inference rule. Replication showed several improvements but introduced a paired false-finding regression.
Release state
Version: 1.3.0
Status: release candidate
YNM-EMP-001: NOYNM-EMP-002: NOYNM-EMP-003: NOPublication authorization: REQUIRES_HUMAN
The evidence does not support releasing this 1.3.0 candidate. Any correction belongs to a later candidate and requires fresh fixtures; the consumed benchmark cannot be reused as independent evidence.
YNM-VAL-001remains MAYBE.This PR does not merge, tag, publish, or claim independent interoperability.