Repository navigation
feat(prompt): Report limits plainly with the closest useful answer - #2417
sentry-junior[bot] wants to merge 1 commit into
Conversation
Move the last core-behavior line from the consumer SOUL.md into the <failure-reporting> block, so every install gets it and the Personality block can be voice only (getsentry/junior-prod#576). Co-Authored-By: David Cramer <david@sentry.io>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
Closing without merging. We dropped the line from SOUL.md in getsentry/junior-prod#578 instead of moving it to core. Core already covers the cases that matter: the evidence and failure-reporting rules (say what was checked and what blocked a stronger answer), the Slack posting-limitation rule, and task-execution (deliver the work and state the open question). No eval shows a gap without it, so per policies/system-prompt.md we shouldn't add a rule without evidence. If an eval later shows the bot stonewalling on a missing capability, we can revisit with that evidence. |
Sentry Evalsjunior-behavioral
Base commit junior-integration
Base commit |
Adds one line to the conversation-mode
<failure-reporting>block (block 6 inpolicies/system-prompt.md):Why: getsentry/junior-prod#576 makes Sentry's
SOUL.mdvoice only. Since #2371, Personality comes after all core rules, so behavior rules left in SOUL can win conflicts with core rules. I checked each behavior line in SOUL against the core blocks. All of them already have a core home except this one, so this PR moves it into core instead of dropping it. Every install gets it now, not only Sentry's.<output>: "Start with the answer or result"<evidence>: "Do not present an inferred fact as verified", plus the uncertain-answer rule<evidence>: verification source order, plus "empty, stale, ambiguous" retry<safety>: "Stay within … the runtime's available capabilities", plus<evidence>claims about access<task-execution>and<evidence><output>length targetAutomation and child-agent runs keep their own failure paths (
finishAutomationRunreason,reportBlocked), so the line is only in conversation mode.Checks: prettier and
@sentry/juniortypecheck pass. This is a prompt change, so the behavioral and integration evals should run on it.Refs getsentry/junior-prod#576
via David Cramer.
--
View Session [Sentry]