Skip to content

Catch a promise to tell the team when it is written with "I'll" - #39

Merged
aryanorastar merged 1 commit into
BasedHardware:mainfrom
singhharsh1708:fix/future-tense-staff-promises
Oct 11, 2026
Merged

aryanorastar merged 1 commit into
BasedHardware:mainfrom
singhharsh1708:fix/future-tense-staff-promises

Conversation

@singhharsh1708

Copy link
Copy Markdown
Contributor

Customer problem

The bot can tell a customer "I'll make sure the team sees this" or "I'll let the team know" when nobody has been told. The staff-lie filter removes "I will make sure the team sees this", but its pattern reads i (will|I'll), so the contraction never matches. Promises in the future tense are not covered at all: "I'll flag this to the team", "I'll forward this to support", "I'll escalate this for you".

Change

The contraction is fixed, and the same promise is caught in the future tense: "I will", "I'll" or "I'm going to", then let, tell, notify, flag, forward, escalate or pass, aimed at the team, staff, support or a person. A straight or a curly apostrophe both match. "I'll tell you how to contact support" and "let the team know in this thread" are left alone.

Evidence

AGENTS.md: a customer is told honestly what happens next, and the PR checklist forbids any claim that a person was pinged without confirmed success. Old and new verdicts over every string literal in the repo's sources, tests and scripts (3192) differ only on the new test lines.

Verification

  • Added or updated a focused behavior test: two in test/honesty.test.js. The first fails on main; the second keeps offers the customer can act on
  • npm test: 628/628
  • EVAL_NO_MODEL=1 node scripts/customer-eval.js: 8/8
  • Live-model evaluation not needed: the prompt and the model path are unchanged
  • No secrets, customer PII, .env, or railway.toml
  • No new claim that a person was pinged, an issue was filed, or an email was sent without confirmed success

The staff-lie filter removed "I will make sure the team sees this" but
not "I'll make sure the team sees this": the pattern read
"i (will|I'll)", so the contraction never matched. Promises in the
future tense were not covered at all, so "I'll let the team know" and
"I'll flag this to support" reached the customer though nobody had been
told. Both forms are caught now, with a straight or a curly apostrophe.
@aryanorastar
aryanorastar merged commit 8321439 into BasedHardware:main Oct 11, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants