Skip to content

feat(evals): evaluate typed-decision pre-filter against historical PR triage #1508

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
potiuk merged 12 commits into from
Oct 6, 2026
Merged

feat(evals): evaluate typed-decision pre-filter against historical PR triage #1508

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
8e0bace
feat(evals): evaluate typed-decision pre-filter against historical PR…
onlyarnav Oct 4, 2026
dbefa1c
fix(evals): place SPDX header above doctoc block in evaluation report
onlyarnav Oct 4, 2026
137285e
fix(evals): drop ungrounded report and default --output-markdown to None
onlyarnav Oct 5, 2026
99e829c
fix(evals): trim bulky PR bodies in historical sample and revert typo…
onlyarnav Oct 5, 2026
7ccb135
refactor(evals): require live decision provider and handle mid-run er…
onlyarnav Oct 5, 2026
43aa5ff
refactor(evals): link prompt builder and bucket taxonomy to pr-triage…
onlyarnav Oct 5, 2026
e647935
fix(evals): fix typos and ensure trailing newline in historical sample
onlyarnav Oct 5, 2026
8cae65d
fix(evals): complete truncated words and close markdown tags in histo…
onlyarnav Oct 5, 2026
4ebd8db
refactor(evals): catch only provider errors and track error_total sep…
onlyarnav Oct 6, 2026
aa816b4
test(evals): pass explicit dataset and mock provider in live-provider…
onlyarnav Oct 6, 2026
369bf99
refactor(evals): drop unmeasured narrative assertions and describe ru…
onlyarnav Oct 6, 2026
c9d8e98
refactor(evals): drop remaining unmeasured report claims and latency …
potiuk Oct 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading