Skip to content
View HomenShum's full-sized avatar

Block or report HomenShum

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
HomenShum/README.md
Homen Shum: An agent's claim that it finished is worthless unless the proof could have failed.

I build the evidence layer that makes agent work checkable.
Proof-Driven Development — the method, in one page. No framework. No install.


The method

Proof-Driven Development rests on three rules:

  1. Default FAIL. Every criterion starts false. The agent cannot mark it passing without opening the evidence first.
  2. The proof must be able to fail. If the behavior broke tomorrow, would this check turn red? If not, it is decoration.
  3. The judge never built it. The grader gets a fresh context and no write tools.

Rule 2 is the one most systems skip. It is also the one that finds fake evidence.

Where the method came from

Context What I built Result
Meta Product Quality & Experience (embedded via Tests Assured) Planted-bug evaluation for an agentic QA platform 1.00 precision, 0.80 recall, 0.89 F1; rerun cost −98%
JPMorgan Commercial Banking Agentic-RAG diligence over 100,000+ documents, human review preserved Prospecting 4 hr to 15–30 min; a 2,000-company analysis 3 weeks to under 15 min
AWS DeepRacer, JPMorgan Palo Alto team Reward-function and race-line optimization Lap time 23.260 s to 18.121 s (theoretical line optimum: 19.673 s)

Rule 2 is not theory. Planted bugs are how I learned that a passing check often proves nothing.

The system, in layers

Layer Repo
Doctrine proof-driven-development
Reference implementation NodeProof — executable proof gates that block unsupported completion claims
Components NodeRL (task evaluation) · NodeTrace (surface to span) · NodeMem (memory gates) · agentic-ui-qa (artifact-only completion) · AgentRedteam
Instruments FeatureClipStudio (walkthrough clips as reproducible proof media) · NodeAgent (the distilled core, with its public conformance suite)
Applications NodeRoom — the flagship: a live human-agent workspace, in production at noderoom.live · NodeBenchAI (entity intelligence, live at nodebenchai.com) · NodeVoice (shared-state voice rooms)

One idea. The rest are parts of it. If you only open two: the doctrine page, then NodeRoom — the method and the thing it built.

Selected projects

NodeRoom: Humans and agents edit one room together, without clobbering each other. NodeBench AI: Entity intelligence for any company, market, or question. NodeAgent: The room asks. The agent answers — with sources, a model, and a memo. NodeProof: Runs your gate on coding-agent work and records the verdict. NodeVoice: Shared state for voice agents that speak in the same room. FeatureClipStudio: Turn live product flows into storyboarded proof clips.

All 19 projects, grouped by layer →

Background

3.5 years inside JPMorgan commercial banking: credit underwriting, covenant analysis, and startup banking. 72 credit transactions, roughly $800M in aggregate exposure, 270 financial models. Then I became the engineer who builds the AI that automates that work.

The role this points at is forward-deployed / applied AI engineering: strongest where regulated, document-heavy workflows need agents somebody can actually check.

Contact

LinkedIn · nodebenchai.com · hshum2018@gmail.com


Feedback wanted. Rule 2 does not scale by hand. Breaking each behavior on purpose is cheap for three checks and expensive for three hundred. If you have solved this for agent workflows, I want to hear how.

Pinned Loading

  1. NodeRoom NodeRoom Public

    Collaborative diligence room for humans and NodeAgents, with spreadsheets, notebooks and a post-it wall. Versioned CAS writes and reviewable proposals; keyless scripted demo. Shared Convex state an…

    TypeScript 3

  2. NodeBenchAI NodeBenchAI Public

    Entity intelligence for any company, market, or question — not a chatbot that answers once, but a system that synthesizes with sources, turns each run into a reusable artifact, and watches for chan…

    TypeScript 15 3

  3. NodeAgent NodeAgent Public

    Agent runtime for room context, document lookup, versioned spreadsheets and notebook memos, with a keyless scripted demo and optional provider adapters.

    HTML 2

  4. FeatureClipStudio FeatureClipStudio Public

    FeatureClipStudio: reproducible Playwright-to-Remotion feature walkthrough GIF/video capture with annotated proof clips.

    JavaScript 1

  5. NodeVoice NodeVoice Public

    NodeVoice: shared-state voice rooms for multi-agent voice coordination, steering, traces, and agent-work governance

    TypeScript 1

  6. NodeProof NodeProof Public

    NodeProof: portable proof supervisor for coding agents; one prompt starts the loop, deterministic gates prove the app works.

    TypeScript 1