Repository navigation
Add a Codex CLI runner for the guided workflow - #324
Merged
Merged
Conversation
examples/codex_exec_runner.py runs codex exec --json in a read-only sandbox and converts its event stream into native traces: tool spans for commands and other tool items, model spans for visible model items and tool decisions, and provider turn usage on the turn's last model span. docs/CODEX.md documents the mapping and a first interleaved run, in which the tool-surface change was rejected on latency. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Important
This repository does not receive automatic reviews because it has fewer than 10 stars.
|
AgentLoop replay self-testThis required repository check evaluates generated synthetic demo traces. It tests the replay and CI machinery; it does not show that this PR improves application performance. AgentLoop CI Report
Performance Gates
Trace inputsThis comparison includes synthetic data. It does not establish application performance gains from a pull request.
Metric Impact
Top Findings
|
The by-name download immediately after upload kept missing the newly finalized python-package artifact. Use the upload step's artifact ID and compare bytes independent of the extracted directory layout. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
To let AgentLoop profile and compare OpenAI Codex CLI runs, the first real coding agent tried with the guided workflow outside the Hermes example.
What
examples/codex_exec_runner.py: a standardimprove capturerunner.codex exec --json --ephemeral --sandbox read-only --cd DIR -with the task prompt on stdin.tool_callspans; non-zero exit codes are errors;agent_message/reasoningitems and silent tool decisions becomemodel_callspans;turn.completedusage goes on the turn's last model span as provider counts (usage_scope: turn_total, cached and reasoning tokens in metadata);turn.failed/errormarks the root span as an error.--pass tocodex execunchanged, so candidates can vary model, effort or features.examples/codex_repository_tasks.json: three repository metadata lookups with exact expected values.docs/CODEX.md(linked from the nav andINTEGRATIONS.md): the event mapping, usage, and the first observed run.First observed run (Codex CLI 0.167.1, Windows)
split_large_stepwas reported on every attempt.apps,browser_useandcomputer_usefeatures, run against the new interleaved control.engines.nodepairs were slower and failed latency gates, so the change was rejected.Raw traces stay local under
runs/(ignored), not committed.Tests
tests/test_codex_exec_runner.py(8 tests) uses a recorded event shape and needs no Codex or network:agentloop,examplesandtests.CI fix
The
Package artifact and wheel smokejob failed three times in a row withArtifact not found for name: python-package, even though the upload had just succeeded. The download now uses the upload step'sartifact-id, and the byte comparison no longer depends on the extracted directory layout.tests/test_release_workflows.pypasses.🤖 Generated with Claude Code