Skip to content

Bound repeated generation input in long Codex rollouts - #107

Draft
johnbuccola wants to merge 1 commit into
langfuse:mainfrom
johnbuccola:jb/fix-hook-memory
Draft

johnbuccola wants to merge 1 commit into
langfuse:mainfrom
johnbuccola:jb/fix-hook-memory

Conversation

@johnbuccola

Copy link
Copy Markdown

Change

Bound the repeated generation input on long Codex rollouts. The turn and tool spans still carry their evidence. Ordinary rollouts keep the existing generation input. Compaction records, which the parser does not use, are no longer retained.

Check

  • 121 plugin tests and lint pass.
  • Replayed a 37 MB rollout that previously aborted Node with an out of memory error. The Stop hook completes in about 1.7 seconds against a local receiver.

Limit

This prevents the observed repetition failure. Very large rollouts still need a streaming parser with durable turn retry handling. The fallback marks omitted generation input in the trace.

@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


John Buccola seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants