Skip to content

fix(ci): name the Test_Toolkit commit, and key the dataset-test cache on it - #36

Merged
sakanni merged 1 commit into
developfrom
CI_Toolkit-#34-ShowTestToolkitCommit
Oct 18, 2026
Merged

sakanni merged 1 commit into
developfrom
CI_Toolkit-#34-ShowTestToolkitCommit

Conversation

@sakanni

@sakanni sakanni commented Oct 18, 2026 •

Copy link
Copy Markdown
Collaborator

Issues addressed by this PR

Closes #34

Closes #35

The compliance rules come from whatever Test_Toolkit's develop holds when the runner cache is cold. That stays, by decision now rather than by default, so the compliance job summary names the Test_Toolkit commit next to the coverage line. The resolver already recorded it, in a dependency table further up the job, which is not where someone looking at a red is looking. When no commit was recorded the line says so, because that also means the cache key lost its Test_Toolkit component on that run.

ci-dataset-tests cached its runner under a fixed key, so a Test_Toolkit change did not invalidate it even though DatasetTestRunner copies five Test_Toolkit assemblies into the cached output. It now reads the SHA and folds it into the cache prefix, the way ci-compliance has since it was written.

Test files

Three Pester assertions on the compliance summary and five on the dataset-tests cache key, including that both actions read the SHA the same way. Existing tests are unmodified.

Reverting the two action changes fails seven of the eight. The eighth asserts the SHA has one source and passes either way by design, so it covers a later second lookup rather than this change.

Changelog

A compliance run now says which Test_Toolkit commit produced its verdict, and a change to the test engine no longer leaves ci-dataset-tests running an older one out of cache.

… on it

The compliance rules come from whatever Test_Toolkit's develop holds when the
runner cache is cold. That stays, by decision rather than by default, but it is
only safe while the version is visible, so the compliance job summary now names
the Test_Toolkit commit next to the coverage line. The resolver already recorded
it, in a dependency table further up the job, which is not where someone looking
at a red is looking.

ci-dataset-tests cached its runner under a fixed key, so a Test_Toolkit change
did not invalidate it even though DatasetTestRunner copies five Test_Toolkit
assemblies into the cached output. It now reads the SHA and folds it into the
cache prefix, the way ci-compliance has since it was written.

Closes #34
Closes #35
@sakanni
sakanni marked this pull request as ready for review October 18, 2026 18:59
@sakanni
sakanni merged commit a4e1558 into develop Oct 18, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ci-dataset-tests: its runner cache ignores Test_Toolkit changes ci-compliance: keep floating on Test_Toolkit, show which commit ran

1 participant