Skip to content

Unify test tooling and centralize test assets - #187

Merged
sancarn merged 2 commits into
masterfrom
codex/unify-testing
Nov 1, 2026
Merged

sancarn merged 2 commits into
masterfrom
codex/unify-testing

Conversation

@sancarn

@sancarn sancarn commented Nov 1, 2026

Copy link
Copy Markdown
Owner

Consolidates test execution under Tools/Testing/run.py and moves test-only harnesses and fixtures into root tests/. An explicit manifest supports aggregate runs, individual suites and named cases, with shared Office isolation, dialog/time limits, structured results and exact settings restoration. Callback and Regex cases are independently selectable; the newly merged Enumerator harness is included.

Breaking changes:

  • Replace commands in the removed Tools/*-tests folders with the corresponding shared runner suite IDs documented in tests/README.md.
  • Replace stdLambda.protRunVMTests with python Tools/Testing/run.py --suite stdLambda.vm --test Instructions; private VM tests are injected into a disposable class copy.

Validation:

  • Default aggregate: 28 cases passed, with 653 reported VBA assertions.
  • 18 native Window ABI cases and three Office failure-handling checks passed.
  • Selected Lambda VM, Timer and Word Regex checks passed.
  • After rebasing onto current master, the migrated Enumerator harness passed 93 existing assertions and streaming/cursor probes.
  • Generated docs compared against the PR base: only the intended Lambda test member and associated test TODOs were removed. Changed text files were checked for CRLF; diff whitespace checks pass.

Not every opt-in suite was executed. Unsupported Access automation, the workbook-bound Clipboard suite and the historical Regex comparison are explicit skips; native Regex ABI tests require llvm-mingw clang. Legacy full-test branches require --full.

@sancarn
sancarn merged commit 230aea3 into master Nov 1, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants