Repository navigation
Audit 288 Sarvam source episodes and isolate reporting failures - #57
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The completed ordinary-source comparison separates answer truth, safe backend outcomes and reporting-contract errors across 288 episodes. It finds four unsafe writes in the unenforced Conversations arm, none in the guarded arm, and 18 empty base105B final outputs after useful native answers or successful writes. The frozen runtime, models, raw outputs and original grades are preserved.
Add offline aggregation with explicit read/action denominators and a same-call backend replay that flips only approval enforcement. Publish all 723 request receipts, SQLite states, frozen contracts, usage accounting and the assistant review of all 89 flagged episodes. No memory implementation or general multilingual accuracy claim is made.
Validation: 143 focused tests, Ruff/diff checks, full request/state/meter replay, prospective attribution and independent aggregation. A clean committed Git export verifies all 3,083 artifact hashes and exactly reproduces all four audit outputs. New comparison estimate INR65.255115; cumulative native research retained INR196.384594 within the existing INR6,000 ceiling. No unknown new usage or retries.
Five independent commits are preserved. English baseline and founder files are outside this change. Detailed results, scope limits and the next single-variable reporting experiment are in the evidence report.