Skip to content

fix(docs): clarify claude_code_exec and codex_exec optimizer support #269

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
RohithPariki wants to merge 1 commit into
base: main
Choose a base branch
from
+28 −4
Open

fix(docs): clarify claude_code_exec and codex_exec optimizer support #269

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/guide/configuration.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,8 +44,8 @@ model:
| `qwen_chat` | ✓ | ✓ | Qwen served through an OpenAI-compatible endpoint (self-hosted vLLM/SGLang or a hosted gateway) |
| `minimax_chat` | ✓ | ✓ | MiniMax API |
| `copilot_chat` | ✓ | ✓ | GitHub Copilot CLI (`copilot -p`); alias `copilot` |
| `codex_exec` | — | ✓ | Codex CLI execution harness |
| `claude_code_exec` | — | ✓ | Claude Code CLI execution harness |
| `codex_exec` | ✓ | ✓ | Codex CLI execution harness |
| `claude_code_exec` | ✓ | ✓ | Claude Code CLI execution harness |
| `cursor_exec` | — | ✓ | Cursor Agent CLI execution harness |
| `copilot_exec` | — | ✓ | GitHub Copilot CLI execution harness |

Expand Down
24 changes: 24 additions & 0 deletions docs/reference/cli.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -115,6 +115,30 @@ disabled. Read-only Ask-mode rollouts may explicitly disable it. Override the
executable or sandbox through `model.cursor_exec_path` and
`model.cursor_exec_sandbox`.

To train or evaluate with the Claude Code CLI execution harness (`claude_code_exec`):

```bash
# Target-only rollout through Claude Code (optimizer defaults to configured chat backend):
python scripts/train.py \
--config configs/searchqa/default.yaml \
--backend claude_code_exec

# Explicitly drive both target and optimizer roles with Claude Code:
python scripts/train.py \
--config configs/searchqa/default.yaml \
--cfg-options \
model.optimizer_backend=claude_code_exec \
model.target_backend=claude_code_exec
```

When `claude_code_exec` is selected as the target backend, SkillOpt streams SDK
messages from the Claude Code process and parses text, tool calls, and tool
results into structured trace steps (`claude_trace_steps.txt`). When
`model.claude_trace_to_optimizer` is enabled (`true` by default), these trace
steps are injected into the reflection prompt so the optimizer can inspect the
agent's intermediate actions.


## SkillOpt-Sleep

```bash
Expand Down
4 changes: 2 additions & 2 deletions docs/reference/config.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ selecting the generic OpenAI-compatible backend.
| `minimax_chat` | ✓ | ✓ |
| `copilot_chat` | ✓ | ✓ |
| `codex_exec` | ✓ | ✓ |
| `claude_code_exec` | — | ✓ |
| `claude_code_exec` | ✓ | ✓ |
| `cursor_exec` | — | ✓ |
| `copilot_exec` | — | ✓ |

Expand All @@ -34,7 +34,7 @@ resolves to `https://api.minimax.io/v1` and `cn_zh` resolves to
| `model.backend` | str | `azure_openai` | Backward-compatible high-level run label |
| `model.optimizer` | str | `gpt-5.5` | Optimizer deployment/model |
| `model.target` | str | `gpt-5.5` | Target deployment/model |
| `model.optimizer_backend` | str | `openai_chat` | Optimizer client path; chat backends plus `codex_exec` |
| `model.optimizer_backend` | str | `openai_chat` | Optimizer client path; chat backends plus `codex_exec` and `claude_code_exec` |
| `model.target_backend` | str | `openai_chat` | Target client path; chat or exec backend |
| `model.reasoning_effort` | str | `medium` | Shared reasoning effort |
| `model.rewrite_reasoning_effort` | str | empty | Optional full-rewrite effort override |
Expand Down