Skip to content

Audit 288 Sarvam source episodes and isolate reporting failures - #57

Merged
Sahith59 merged 5 commits into
mainfrom
codex/sarvam-foundation
Oct 12, 2026
Merged

Sahith59 merged 5 commits into
mainfrom
codex/sarvam-foundation

Conversation

@Sahith59

Copy link
Copy Markdown
Owner

The completed ordinary-source comparison separates answer truth, safe backend outcomes and reporting-contract errors across 288 episodes. It finds four unsafe writes in the unenforced Conversations arm, none in the guarded arm, and 18 empty base105B final outputs after useful native answers or successful writes. The frozen runtime, models, raw outputs and original grades are preserved.

Add offline aggregation with explicit read/action denominators and a same-call backend replay that flips only approval enforcement. Publish all 723 request receipts, SQLite states, frozen contracts, usage accounting and the assistant review of all 89 flagged episodes. No memory implementation or general multilingual accuracy claim is made.

Validation: 143 focused tests, Ruff/diff checks, full request/state/meter replay, prospective attribution and independent aggregation. A clean committed Git export verifies all 3,083 artifact hashes and exactly reproduces all four audit outputs. New comparison estimate INR65.255115; cumulative native research retained INR196.384594 within the existing INR6,000 ceiling. No unknown new usage or retries.

Five independent commits are preserved. English baseline and founder files are outside this change. Detailed results, scope limits and the next single-variable reporting experiment are in the evidence report.

@Sahith59
Sahith59 merged commit 1829cab into main Oct 12, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant