roachtest: c2c/mixed-version failed

[cockroach-teamcity]

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.c2c/mixed-version failed with artifacts on master @ 7f2055b8df61f878478f12c4caed7c41cc43a392:

(mixedversion.go:852).Run: dest: mixed-version test failure while running step 19 (restart node 7 with binary version master): failed to wait for replication after starting cockroach: failed to wait for SQL to be ready: read tcp 172.17.0.3:59932 -> 35.227.15.29:26257: i/o timeout
(mixedversion.go:852).Run: source: preparing to run step 28: failed to get binary version for node 4 (system): context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=true
• mvtDeploymentMode=system-only
• mvtVersions=v25.2.2 → master
• runtimeAssertionsBuild=true
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

• roachtest: c2c/mixed-version failed #150047 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot P-2 T-disaster-recovery branch-release-25.3]

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-52694

[cockroach-teamcity]

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.c2c/mixed-version failed with artifacts on master @ c0b904a99b6a067b8ca17f5a60e7e0d0f3d79883:

(mixedversion.go:852).Run: dest: mixed-version test failure while running step 21 (restart node 5 with binary version master): failed to wait for replication after starting cockroach: failed to wait for SQL to be ready: read tcp 172.17.0.3:39298 -> 34.138.125.174:26257: i/o timeout
(mixedversion.go:852).Run: source: preparing to run step 28: failed to get binary version for node 4 (system): context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=true
• mvtDeploymentMode=system-only
• mvtVersions=v25.2.2 → master
• runtimeAssertionsBuild=true
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

• roachtest: c2c/mixed-version failed #150047 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot P-2 T-disaster-recovery branch-release-25.3]

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.c2c/mixed-version failed with artifacts on master @ 724f1d5f160e2219ebf691fb4335629461b416f6:

(mixedversion.go:852).Run: dest: mixed-version test failure while running step 25 (restart node 8 with binary version master): failed to wait for replication after starting cockroach: failed to wait for SQL to be ready: pq: internal error while retrieving user account memberships: operation "get-user-session" timed out after 10.008s (given timeout 10s): internal error while retrieving user account: get auth info error: interrupted during singleflight acquire-lease:1: context deadline exceeded
(mixedversion.go:852).Run: source: preparing to run step 28: failed to get binary version for node 4 (system): context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/cpu_arch=arm64/run_1

Parameters:

• arch=arm64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=false
• mvtDeploymentMode=system-only
• mvtVersions=v25.2.2 → master
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

• roachtest: c2c/mixed-version failed #150047 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot P-2 T-disaster-recovery branch-release-25.3]

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.c2c/mixed-version failed with artifacts on master @ baf14b944853030ed5c034c4b1791c88bbc090a8:

(mixedversion.go:852).Run: dest: preparing to run step 27: failed to get binary version for node 5 (system): pq: query execution canceled
(mixedversion.go:852).Run: source: preparing to run step 26: failed to get binary version for node 4 (system): context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=true
• mvtDeploymentMode=system-only
• mvtVersions=v25.2.2 → master
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

• roachtest: c2c/mixed-version failed #150606 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot T-disaster-recovery branch-release-25.3.0-rc release-blocker]
• roachtest: c2c/mixed-version failed #150047 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot P-2 T-disaster-recovery branch-release-25.3]

This test on roachdash | Improve this report!

[cockroach-teamcity]

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.c2c/mixed-version failed with artifacts on master @ f43db402f520dd947d2aa3f742879ba2fe03e048:

(mixedversion.go:852).Run: dest: mixed-version test failure while running step 20 (restart node 7 with binary version master): failed to wait for replication after starting cockroach: failed to wait for SQL to be ready: read tcp 172.17.0.3:38810 -> 34.148.102.234:26257: i/o timeout
(mixedversion.go:852).Run: source: preparing to run step 25: failed to get binary version for node 4 (system): context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=true
• mvtDeploymentMode=system-only
• mvtVersions=v25.2.2 → master
• runtimeAssertionsBuild=true
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

• roachtest: c2c/mixed-version failed #150606 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot T-disaster-recovery branch-release-25.3.0-rc release-blocker]
• roachtest: c2c/mixed-version failed #150047 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot P-2 T-disaster-recovery branch-release-25.3]

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.c2c/mixed-version failed with artifacts on master @ f43db402f520dd947d2aa3f742879ba2fe03e048:

(mixedversion.go:852).Run: dest: preparing to run step 29: failed to get binary version for node 6 (system): pq: query execution canceled
(mixedversion.go:852).Run: source: preparing to run step 29: failed to get binary version for node 4 (system): context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/cpu_arch=arm64/run_1

Parameters:

• arch=arm64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=false
• mvtDeploymentMode=system-only
• mvtVersions=v25.2.2 → master
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

• roachtest: c2c/mixed-version failed #150606 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot T-disaster-recovery branch-release-25.3.0-rc release-blocker]
• roachtest: c2c/mixed-version failed #150047 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot P-2 T-disaster-recovery branch-release-25.3]

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.c2c/mixed-version failed with artifacts on master @ 4a0f95aa0f11360e85a3221a8563a521d3f5499b:

(mixedversion.go:852).Run: dest: preparing to run step 23: failed to get binary version for node 7 (system): pq: query execution canceled
(mixedversion.go:852).Run: source: preparing to run step 29: failed to get binary version for node 4 (system): context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=true
• mvtDeploymentMode=system-only
• mvtVersions=v25.2.2 → master
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

• roachtest: c2c/mixed-version failed #150665 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot T-disaster-recovery branch-release-25.2 release-blocker]
• roachtest: c2c/mixed-version failed #150606 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot T-disaster-recovery branch-release-25.3.0-rc release-blocker]
• roachtest: c2c/mixed-version failed #150047 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot P-2 T-disaster-recovery branch-release-25.3]

This test on roachdash | Improve this report!

[cockroach-teamcity]

roachtest.c2c/mixed-version failed with artifacts on master @ afef2d239966541de7611883fbb803f08c0fed92:

(mixedversion.go:852).Run: dest: preparing to run step 22: failed to get binary version for node 8 (system): pq: internal error while retrieving user account memberships: operation "get-user-session" timed out after 10.016s (given timeout 10s): internal error while retrieving user account: get auth info error: interrupted during singleflight acquire-lease:1: context deadline exceeded
(mixedversion.go:852).Run: source: preparing to run step 26: failed to get binary version for node 4 (system): context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/run_1

Parameters:

• arch=amd64
• cloud=gce
• coverageBuild=false
• cpu=8
• encrypted=false
• fs=ext4
• localSSD=true
• mvtDeploymentMode=system-only
• mvtVersions=v25.2.2 → master
• runtimeAssertionsBuild=false
• ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

• roachtest: c2c/mixed-version failed #150665 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot T-disaster-recovery branch-release-25.2 release-blocker]
• roachtest: c2c/mixed-version failed #150606 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot T-disaster-recovery branch-release-25.3.0-rc release-blocker]
• roachtest: c2c/mixed-version failed #150047 roachtest: c2c/mixed-version failed [A-disaster-recovery C-test-failure O-roachtest O-robot P-2 T-disaster-recovery branch-release-25.3]

This test on roachdash | Improve this report!