Skip to content

test: disable tool installation when loading examples - #4669

Merged
aheritier merged 1 commit into
mainfrom
fix/example-tests-no-auto-install
Oct 20, 2026
Merged

aheritier merged 1 commit into
mainfrom
fix/example-tests-no-auto-install

Conversation

@dgageot

@dgageot dgageot commented Oct 20, 2026 •

Copy link
Copy Markdown
Member

Summary

Disable automatic tool installation only inside TestLoadExamples, using the existing DOCKER_AGENT_AUTO_INSTALL=false opt-out before its parallel subtests start. Example parsing and construction assertions remain unchanged; installer tests retain their existing coverage.

Complements #4647, which opted out the dedicated LSP tests but not example loading. Implements the first test-specific finding from #4664. No profiling workflow or production-code changes.

Hosted results

CI run passed, including Linux, Windows, cross-compile, lint, and gate. CodeQL passed too. Raw test artifacts contain no tool-installation messages from pkg/teamloader.

Previously these example subtests took roughly 24–51 seconds each because they waited for gopls installation. After this change:

Example Linux Windows
toolset-working-dir.yaml 0.13s 0.09s
coder.yaml 0.15s 0.08s
gopher.yaml 0.20s 0.15s
modernize-go-tests.yaml 0.17s 0.08s

These are individual subtest durations, not additive CI wall-time savings; setup, other tests, and runner variation still affect whole-job timing.

Validation

  • task build, task test, task lint
  • Uncached go test -count=1 -json ./pkg/teamloader
  • Targeted race check and existing installer opt-out tests
  • Hosted Linux and Windows suites and CodeQL

Commit is cryptographically signed and DCO-signed.

@aheritier aheritier added area/testing Test infrastructure, CI/CD, test runners, evaluation kind/test Test-only changes labels Oct 20, 2026
@dgageot
dgageot marked this pull request as ready for review October 20, 2026 10:01
@dgageot
dgageot requested a review from a team as a code owner October 20, 2026 10:01
@dgageot
dgageot added this pull request to the merge queue Oct 20, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Oct 20, 2026
@dgageot
dgageot added this pull request to the merge queue Oct 20, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Oct 20, 2026
@aheritier
aheritier added this pull request to the merge queue Oct 20, 2026
Merged via the queue into main with commit 1bf02d6 Oct 20, 2026
16 checks passed
@aheritier
aheritier deleted the fix/example-tests-no-auto-install branch October 20, 2026 15:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/testing Test infrastructure, CI/CD, test runners, evaluation kind/test Test-only changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants