maint: unable to start docker site with missing files from debian

[mcdurdin]

#19 2.837 Fetched 17.2 MB in 0s (38.8 MB/s)
#19 2.837 E: Failed to fetch http://deb.debian.org/debian-security/pool/updates/main/e/exim4/exim4-daemon-light_4.94.2-7%2bdeb11u6_amd64.deb  404  Not Found [IP: 151.101.42.132 80]
#19 2.837 E: Failed to fetch http://deb.debian.org/debian-security/pool/updates/main/m/mariadb-10.5/mariadb-common_10.5.29-0%2bdeb11u1_all.deb  404  Not Found [IP: 151.101.42.132 80]
#19 2.837 E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
#19 ERROR: process "/bin/sh -c apt-get update && apt-get install -y     cron" did not complete successfully: exit code: 100

e.g. https://github.com/keymanapp/keymanweb.com/actions/runs/34125359222/job/101752658285

[mcdurdin]

Reproduced with docker build --no-cache locally. The php-7.4 image needs updating.

https://unix.stackexchange.com/questions/743839/apt-get-update-failed-to-fetch-debian-amd64-packages-while-building-dockerfile-f may be relevant

Note that the relevant packages are not present on archive.debian.org, though older ones are...

[mcdurdin]

Full log:

[/d/Projects/keyman/sites/keymanweb.com] Building using debug configuration
[+] Building 10.8s (17/26)                                                                                                                                                                                                docker:desktop-linux
 => [internal] load build definition from Dockerfile                                                                                                                                                                                      0.0s
 => => transferring dockerfile: 1.27kB                                                                                                                                                                                                    0.0s
 => resolve image config for docker-image://docker.io/docker/dockerfile:1                                                                                                                                                                 1.1s
 => CACHED docker-image://docker.io/docker/dockerfile:1@sha256:ecfaec9ed6d810b56388c508f4121597bfbba70d41a6dfeee4d8cad5f295fc32                                                                                                           0.0s
 => [internal] load metadata for docker.io/library/php:7.4-apache@sha256:c9d7e608f73832673479770d66aacc8100011ec751d1905ff63fae3fe2e0ca6d                                                                                                 0.8s
 => [internal] load metadata for docker.io/library/composer:latest                                                                                                                                                                        1.8s
 => [internal] load .dockerignore                                                                                                                                                                                                         0.0s
 => => transferring context: 2B                                                                                                                                                                                                           0.0s
 => [internal] load build context                                                                                                                                                                                                         0.0s
 => => transferring context: 229B                                                                                                                                                                                                         0.0s
 => CACHED [composer-builder 1/8] FROM docker.io/library/php:7.4-apache@sha256:c9d7e608f73832673479770d66aacc8100011ec751d1905ff63fae3fe2e0ca6d                                                                                           0.0s
 => CANCELED FROM docker.io/library/composer:latest@sha256:d8f6343d3fae98107426bc49163ccad46ef85aabd4a27d80a74401fab4aba332                                                                                                               7.6s
 => => resolve docker.io/library/composer:latest@sha256:d8f6343d3fae98107426bc49163ccad46ef85aabd4a27d80a74401fab4aba332                                                                                                                  0.0s
 => => sha256:d8f6343d3fae98107426bc49163ccad46ef85aabd4a27d80a74401fab4aba332 10.10kB / 10.10kB                                                                                                                                          0.0s
 => => sha256:204816b1c5b657cd8fe31ae0bca3daecdd370633c1a3952f6101860003ac8798 11.95kB / 11.95kB                                                                                                                                          0.0s
 => => sha256:e8abfc15eb16e089ac0133588fc40e22868d0a07ccb1423d919804826c244bc9 5.95MB / 5.95MB                                                                                                                                            2.1s
 => => sha256:55afa1ecc21d2bb5e5045f32dafee56272ffd89860bac26f6c32123439af26a4 3.85MB / 3.85MB                                                                                                                                            1.5s
 => => sha256:0baf37e7f495f1c42cee6bdd9cf3e00e9435f193b512529e7c484d66c623773f 3.61kB / 3.61kB                                                                                                                                            0.0s
 => => sha256:bd56ccb5211768a4e9e7ab043b8bb6f6c7b8f784c82338845b7cbf4b960c5c0c 931B / 931B                                                                                                                                                0.7s
 => => sha256:c61db10a066345ea6e76c588074ce538251b06050b519e3c73fd56021208db4a 215B / 215B                                                                                                                                                1.0s
 => => sha256:6a4613157ae3c90a66f322e617856593fda2e67d4f1e5e05696f1e93d7df6d32 14.48MB / 14.48MB                                                                                                                                          3.4s
 => => extracting sha256:55afa1ecc21d2bb5e5045f32dafee56272ffd89860bac26f6c32123439af26a4                                                                                                                                                 0.2s
 => => sha256:c2272599fb31695cff110b58d8b4222e7bf2b64b0abc4b4d59f2fa85e28f8cb0 488B / 488B                                                                                                                                                1.7s
 => => sha256:3610922f636b31a392b957e7e7981d79bbf81f580b02013b34e4dca07d9c6e3d 22.83MB / 22.83MB                                                                                                                                          3.7s
 => => extracting sha256:e8abfc15eb16e089ac0133588fc40e22868d0a07ccb1423d919804826c244bc9                                                                                                                                                 0.2s
 => => sha256:23dc07157ef7d1dce21c40c9f43b30a69091e050123f90622d23b8578347cdb2 2.45kB / 2.45kB                                                                                                                                            2.4s
 => => sha256:dd58bb537f66a30a752d312bf1d5328e3970e9920f52af34fff4446481dfd221 22.36kB / 22.36kB                                                                                                                                          2.8s
 => => extracting sha256:bd56ccb5211768a4e9e7ab043b8bb6f6c7b8f784c82338845b7cbf4b960c5c0c                                                                                                                                                 0.0s
 => => extracting sha256:c61db10a066345ea6e76c588074ce538251b06050b519e3c73fd56021208db4a                                                                                                                                                 0.0s
 => => sha256:4dc8ae5cf961dc76a2f3ac4c799d76f32ec53afe34b16276a50c09952c5c3063 31.96MB / 31.96MB                                                                                                                                          5.1s
 => => extracting sha256:6a4613157ae3c90a66f322e617856593fda2e67d4f1e5e05696f1e93d7df6d32                                                                                                                                                 0.2s
 => => sha256:96a258d35ff873f2ecbbc52802b3c615ed94daee67860f7c9541958addec583d 257B / 257B                                                                                                                                                3.8s
 => => extracting sha256:c2272599fb31695cff110b58d8b4222e7bf2b64b0abc4b4d59f2fa85e28f8cb0                                                                                                                                                 0.0s
 => => sha256:a747bac1a2637ae25dc98d65afa1fd0d343e529f1145b18c8e6b55b41938f0fe 419B / 419B                                                                                                                                                4.1s
 => => sha256:c2b224c93474b6222e5db7cc1c356eaf33b0a66486b70e47d15bb17baf5c113a 1.08MB / 1.08MB                                                                                                                                            4.3s
 => => extracting sha256:3610922f636b31a392b957e7e7981d79bbf81f580b02013b34e4dca07d9c6e3d                                                                                                                                                 1.8s
 => => sha256:e1f5a0519ae078a357e650fb3f19e0f64c14b0b9279f23887f6bfa5c27c55425 93B / 93B                                                                                                                                                  4.4s
 => => extracting sha256:23dc07157ef7d1dce21c40c9f43b30a69091e050123f90622d23b8578347cdb2                                                                                                                                                 0.0s
 => => extracting sha256:dd58bb537f66a30a752d312bf1d5328e3970e9920f52af34fff4446481dfd221                                                                                                                                                 0.0s
 => => extracting sha256:4dc8ae5cf961dc76a2f3ac4c799d76f32ec53afe34b16276a50c09952c5c3063                                                                                                                                                 1.9s
 => [composer-builder 2/8] RUN apt-get update && apt-get install -y     zlib1g-dev     libzip-dev     unzip                                                                                                                               6.7s
 => [stage-1  2/11] COPY resources/keyman-site.conf /etc/apache2/conf-available/                                                                                                                                                          0.0s
 => [stage-1  3/11] RUN cp /usr/local/etc/php/php.ini-production /usr/local/etc/php/php.ini                                                                                                                                               0.2s
 => [stage-1  4/11] RUN chown -R www-data:www-data /var/www/html/                                                                                                                                                                         0.4s
 => [stage-1  5/11] COPY resources/run.sh /usr/local/bin/                                                                                                                                                                                 0.1s
 => [stage-1  6/11] RUN chmod +x /usr/local/bin/run.sh                                                                                                                                                                                    0.3s
 => ERROR [stage-1  7/11] RUN apt-get update && apt-get install -y     cron                                                                                                                                                               6.4s
 => CANCELED [composer-builder 3/8] RUN docker-php-ext-install zip                                                                                                                                                                        1.0s
------
 > [stage-1  7/11] RUN apt-get update && apt-get install -y     cron:
0.521 Get:1 http://deb.debian.org/debian bullseye InRelease [75.1 kB]
0.557 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [27.2 kB]
0.579 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.0 kB]
0.700 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8066 kB]
1.146 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [475 kB]
1.285 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [18.8 kB]
2.659 Fetched 8706 kB in 2s (3992 kB/s)
2.659 Reading package lists...
3.887 Reading package lists...
4.712 Building dependency tree...
4.882 Reading state information...
5.051 The following additional packages will be installed:
5.052   exim4-base exim4-config exim4-daemon-light gsasl-common guile-2.2-libs
5.052   libevent-2.1-7 libfribidi0 libgc1 libgnutls-dane0 libgnutls30 libgsasl7
5.052   libidn11 libltdl7 libmailutils7 libmariadb3 libmpdec3 libntlm0 libpython3.9
5.052   libpython3.9-minimal libpython3.9-stdlib libunbound8 mailutils
5.052   mailutils-common mariadb-common mysql-common netbase psmisc sensible-utils
5.053 Suggested packages:
5.053   anacron logrotate checksecurity exim4-doc-html | exim4-doc-info eximon4
5.053   spf-tools-perl swaks dns-root-data gnutls-bin mailutils-mh mailutils-doc
5.298 The following NEW packages will be installed:
5.298   cron exim4-base exim4-config exim4-daemon-light gsasl-common guile-2.2-libs
5.298   libevent-2.1-7 libfribidi0 libgc1 libgnutls-dane0 libgsasl7 libidn11
5.298   libltdl7 libmailutils7 libmariadb3 libmpdec3 libntlm0 libpython3.9
5.299   libpython3.9-minimal libpython3.9-stdlib libunbound8 mailutils
5.299   mailutils-common mariadb-common mysql-common netbase psmisc sensible-utils
5.301 The following packages will be upgraded:
5.303   libgnutls30
5.385 1 upgraded, 28 newly installed, 0 to remove and 77 not upgraded.
5.385 Need to get 17.9 MB of archives.
5.385 After this operation, 80.6 MB of additional disk space will be used.
5.385 Get:1 http://deb.debian.org/debian bullseye/main amd64 sensible-utils all 0.0.14 [14.8 kB]
5.403 Get:2 http://deb.debian.org/debian bullseye/main amd64 cron amd64 3.0pl1-137 [99.6 kB]
5.425 Get:3 http://deb.debian.org/debian-security bullseye-security/main amd64 libgnutls30 amd64 3.7.1-5+deb11u10 [1345 kB]
5.514 Get:4 http://deb.debian.org/debian bullseye/main amd64 netbase all 6.3 [19.9 kB]
5.514 Err:5 http://deb.debian.org/debian-security bullseye-security/main amd64 exim4-config all 4.94.2-7+deb11u6
5.514   404  Not Found [IP: 151.101.2.132 80]
5.515 Get:6 http://deb.debian.org/debian-security bullseye-security/main amd64 exim4-base amd64 4.94.2-7+deb11u6 [1177 kB]
5.579 Get:7 http://deb.debian.org/debian bullseye/main amd64 libevent-2.1-7 amd64 2.1.12-stable-1 [188 kB]
5.587 Get:8 http://deb.debian.org/debian-security bullseye-security/main amd64 libunbound8 amd64 1.13.1-1+deb11u7 [510 kB]
5.612 Get:9 http://deb.debian.org/debian-security bullseye-security/main amd64 libgnutls-dane0 amd64 3.7.1-5+deb11u10 [396 kB]
5.633 Get:10 http://deb.debian.org/debian bullseye/main amd64 libidn11 amd64 1.33-3 [116 kB]
5.640 Err:11 http://deb.debian.org/debian-security bullseye-security/main amd64 exim4-daemon-light amd64 4.94.2-7+deb11u6
5.640   404  Not Found [IP: 151.101.2.132 80]
5.640 Get:12 http://deb.debian.org/debian-security bullseye-security/main amd64 gsasl-common all 1.10.0-4+deb11u3 [175 kB]
5.648 Get:13 http://deb.debian.org/debian bullseye/main amd64 libgc1 amd64 1:8.0.4-3 [239 kB]
5.659 Get:14 http://deb.debian.org/debian bullseye/main amd64 libltdl7 amd64 2.4.6-15 [391 kB]
5.678 Get:15 http://deb.debian.org/debian bullseye/main amd64 guile-2.2-libs amd64 2.2.7+1-6 [4980 kB]
5.926 Get:16 http://deb.debian.org/debian bullseye/main amd64 libfribidi0 amd64 1.0.8-2+deb11u1 [64.9 kB]
5.928 Get:17 http://deb.debian.org/debian bullseye/main amd64 libntlm0 amd64 1.6-3 [84.7 kB]
5.935 Get:18 http://deb.debian.org/debian-security bullseye-security/main amd64 libgsasl7 amd64 1.10.0-4+deb11u3 [195 kB]
5.954 Get:19 http://deb.debian.org/debian bullseye/main amd64 mailutils-common all 1:3.10-3 [728 kB]
5.988 Get:20 http://deb.debian.org/debian bullseye/main amd64 mysql-common all 5.8+1.0.7 [7464 B]
5.989 Err:21 http://deb.debian.org/debian-security bullseye-security/main amd64 mariadb-common all 1:10.5.29-0+deb11u1
5.989   404  Not Found [IP: 151.101.2.132 80]
5.989 Get:22 http://deb.debian.org/debian-security bullseye-security/main amd64 libmariadb3 amd64 1:10.5.29-0+deb11u1 [179 kB]
5.998 Get:23 http://deb.debian.org/debian-security bullseye-security/main amd64 libpython3.9-minimal amd64 3.9.2-1+deb11u7 [807 kB]
6.038 Get:24 http://deb.debian.org/debian bullseye/main amd64 libmpdec3 amd64 2.5.1-1 [87.7 kB]
6.041 Get:25 http://deb.debian.org/debian-security bullseye-security/main amd64 libpython3.9-stdlib amd64 3.9.2-1+deb11u7 [1685 kB]
6.124 Get:26 http://deb.debian.org/debian-security bullseye-security/main amd64 libpython3.9 amd64 3.9.2-1+deb11u7 [1694 kB]
6.216 Get:27 http://deb.debian.org/debian bullseye/main amd64 libmailutils7 amd64 1:3.10-3+b1 [893 kB]
6.261 Get:28 http://deb.debian.org/debian bullseye/main amd64 mailutils amd64 1:3.10-3+b1 [576 kB]
6.287 Get:29 http://deb.debian.org/debian bullseye/main amd64 psmisc amd64 23.4-2 [198 kB]
6.305 Fetched 16.9 MB in 1s (17.1 MB/s)
6.305 E: Failed to fetch http://deb.debian.org/debian-security/pool/updates/main/e/exim4/exim4-config_4.94.2-7%2bdeb11u6_all.deb  404  Not Found [IP: 151.101.2.132 80]
6.305 E: Failed to fetch http://deb.debian.org/debian-security/pool/updates/main/e/exim4/exim4-daemon-light_4.94.2-7%2bdeb11u6_amd64.deb  404  Not Found [IP: 151.101.2.132 80]
6.305 E: Failed to fetch http://deb.debian.org/debian-security/pool/updates/main/m/mariadb-10.5/mariadb-common_10.5.29-0%2bdeb11u1_all.deb  404  Not Found [IP: 151.101.2.132 80]
6.305 E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
------

 1 warning found (use docker --debug to expand):
 - JSONArgsRecommended: JSON arguments recommended for ENTRYPOINT to prevent unintended behavior related to OS signals (line 40)
Dockerfile:29
--------------------
  28 |     # Install cron
  29 | >>> RUN apt-get update && apt-get install -y \
  30 | >>>     cron
  31 |     COPY resources/cache-keyboards-cron /etc/cron.d/
--------------------
ERROR: failed to build: failed to solve: process "/bin/sh -c apt-get update && apt-get install -y     cron" did not complete successfully: exit code: 100
[/d/Projects/keyman/sites/keymanweb.com] ## build failed

[tim-eves]

I notice that all the missing packages are from debian-security, I wonder if they've been withdrawn due further bugs, further fixes, or some other issue. It's rare but not unheard of.

I tested those URLs here and I got a hit on the 1st but the other 2 returned 404s too. Depending on when the were uploaded it might be that the mirrors haven't fully synced yet.

[mcdurdin]

I tested those URLs here and I got a hit on the 1st but the other 2 returned 404s too. Depending on when the were uploaded it might be that the mirrors haven't fully synced yet.

Hmmmm. Flaky mirrors not making me happy.

[mcdurdin]

Refs:

• https://lists.debian.org/debian-lts/2026/09/msg00030.html
• https://lists.debian.org/debian-mirrors/2026/09/msg00000.html

[mcdurdin]

Now impacting deployments, see https://github.com/keymanapp/s.keyman.com/actions/runs/34261806840/job/102181346990