Repository navigation

refactor(arms): run arms from a typed ArmsRunConfig instead of the parsed Namespace - #270

Merged

antonwolfy merged 12 commits into

intel:mainfrom

vlad-perevezentsev:refactor/arms-run-config

Oct 30, 2026

Merged

refactor(arms): run arms from a typed ArmsRunConfig instead of the parsed Namespace#270
antonwolfy merged 12 commits into
intel:mainfrom
vlad-perevezentsev:refactor/arms-run-config

Commits on Oct 30, 2026
- refactor(arms): move the run's shared checks to dokimi/eval/arms_run.py
  
  vlad-perevezentsev
  authored and
  napetrov
  committed
  449f949
- refactor(arms): run arms run and matrix-run from a typed ArmsRunConfig
  
  vlad-perevezentsev
  authored and
  napetrov
  committed
  59247ce
- refactor(subjects): build the arms run config directly in subjects run
  
  vlad-perevezentsev
  authored and
  napetrov
  committed
  8a79713
- refactor(arms): run the matrix cells in dokimi/eval/arms_run.py
  
  vlad-perevezentsev
  authored and
  napetrov
  committed
  dfb4023
- test(arms): pin that matrix-run reports a blank question with exit 2
  
  xaleryb
  authored and
  napetrov
  committed
  84e6224
- test(answers): import resolve_doc_library_id from dokimi.eval.arms_run
  
  vlad-perevezentsev
  authored and
  napetrov
  committed
  dd0ff82
- fix(arms): ArmsRunConfig picks the default judge for its judge_provider
  
  vlad-perevezentsev
  authored and
  napetrov
  committed
  82a991e
- test(arms): describe what the parity tests pin, not the hand-off they were written against
  
  vlad-perevezentsev
  authored and
  napetrov
  committed
  adf0aff
- chore(growth): lower the test_arm_runner baseline after the rebase onto main
  napetrov
  committed
  6c47f44
- test(arms): point the output-error tests at the moved run_arms
  napetrov
  committed
  29bdc60
- test(arms): keep the config-defaults test's comment block to two lines
  napetrov
  committed
  4877615
- fix(arms): check_matrix names the cell a refusal is about
  napetrov
  committed
  dc01659

Commits

Commits on Oct 30, 2026