Bug#1075848: Debian 12.6: jigdo-ing fails as some packages are broken on cdimage.debian.org

[M. Buecher]

Package: cdimage.debian.org
Version: 12.6

Jigdo downloading the update DVDs for Debian 12.6.0 from cdimage.debian.org fails.

Update DVDs #1 and #3 fail to complete due to packages crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb and termshark_2.4.0-1+b6_amd64.deb onhttp://cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/

When using the German Mirrorftp.de.debian.org then I am able to complete the jigdo download.

So, I checked their SHA256 sums and they differ.

#1 cdimage.debian.org
http://cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/c/crowdsec-custom-bouncer/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb
http://cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb
b4264c6c0be0cd815580efb85d0ab83d8dd4d4ec270608fadeb619900278216d *cdimage/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb
a1d767d398e205af7eefdf9c3785066c3e5de4b0df922dbab9fb80f98b0ab7be *cdimage/termshark_2.4.0-1+b6_amd64.deb

#2ftp.de.debian.org
http://ftp.de.debian.org/debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb
http://ftp.de.debian.org/debian/pool/main/c/crowdsec-custom-bouncer/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb
5a66c3d47e770f0cba5cf33fe0f24df9810cdab01e1d6421a5a6a41b1049f3f9 *de/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb
575632b72bcc8c6666c5cf3b6f9e977a23febfa433e17d096b15513744709729 *de/termshark_2.4.0-1+b6_amd64.deb

Please fix the broken packages on cdimage.debian.org

Kind regards
Matthias "Maddes" BÃŒcher



****@linux-desktop:~/work# sha256sum -c
~/work/iso/Debian/12.6.0/amd64/jigdo-dvd/SHA256SUMS_*
...
sha256sum: debian-update-12.6.0-amd64-DVD-1.iso: No such file or directory
debian-update-12.6.0-amd64-DVD-1.iso: FAILED open or read
*debian-update-12.6.0-amd64-DVD-1.jigdo: OK
debian-update-12.6.0-amd64-DVD-1.template: OK*
sha256sum: debian-update-12.6.0-amd64-DVD-2.iso: No such file or directory
debian-update-12.6.0-amd64-DVD-2.iso: FAILED open or read
*debian-update-12.6.0-amd64-DVD-2.jigdo: OK
debian-update-12.6.0-amd64-DVD-2.template: OK*
sha256sum: debian-update-12.6.0-amd64-DVD-3.iso: No such file or directory
debian-update-12.6.0-amd64-DVD-3.iso: FAILED open or read
*debian-update-12.6.0-amd64-DVD-3.jigdo: OK
debian-update-12.6.0-amd64-DVD-3.template: OK*


****@linux-desktop:~/work# jigdo-lite
/root/work/iso/Debian/12.6.0/amd64/jigdo-dvd/debian-update-12.6.0-amd64-DVD-1.jigdo_*

Jigsaw Download "lite"
Copyright (C) 2001-2009  |  jigdo@
Richard Atterer          |  atterer.org
Copyright (C) 2016-2021
Steve McIntyre <***@debian.org>
Loading settings from `/root/.jigdo-lite'

-----------------------------------------------------------------
Images offered by
`/root/work/iso/Debian/12.6.0/amd64/jigdo-dvd/debian-update-12.6.0-amd64-DVD-1.jigdo':
  1: 'Debian GNU/Linux 12.6.0 - Official amd64 12.60->12.6.0 update DVD
#1' (debian-update-12.6.0-amd64-DVD-1.iso)

Further information about `debian-update-12.6.0-amd64-DVD-1.iso':
Generated on Sat, 29 Jun 2024 11:55:07 +0000

-----------------------------------------------------------------
If you already have a previous version of the CD you are
downloading, jigdo can re-use files on the old CD that are also
present in the new image, and you do not need to download them
again. Mount the old CD ROM and enter the path it is mounted under
(e.g. `/mnt/cdrom').
Alternatively, just press enter if you want to start downloading
the remaining files.

You can also enter a single digit from the list below to
select the respective entry for scanning:
  1: /mnt/iso-stable
  2: /mnt/iso-oldstable
Files to scan:

-----------------------------------------------------------------
The jigdo file refers to files stored on Debian mirrors. Please
choose a Debian mirror as follows: Either enter a complete URL
pointing to a mirror (in the form
`ftp://ftp.debian.org/debian/'), or enter any regular expression
for searching through the list of mirrors: Try a two-letter
country code such as `de', or a country name like `United
States', or a server name like `sunsite'.
Debian mirror [http://cdimage.debian.org/mirror/cdimage/snapshot/Debian/]:


-----------------------------------------------------------------
Merging parts from `file:' URIs, if any...
Found 0 of the 1 files required by the template
Copied input files to temporary file
`debian-update-12.6.0-amd64-DVD-1.iso.tmp' - repeat command and supply
more files to continue
--2024-06-30 18:16:20--
*http://cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/c/crowdsec-custom-bouncer/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb*
Resolving cdimage.debian.org (cdimage.debian.org)... 2001:6b0:19::165,
2001:6b0:19::173, 2001:6b0:19::163, ...
Connecting to cdimage.debian.org
(cdimage.debian.org)|2001:6b0:19::165|:80... connected.
HTTP request sent, awaiting response... *200 OK*
Length: 3412900 (3,3M) [application/x-debian-package]
Saving to:
‘./debian-update-12.6.0-amd64-DVD-1.iso.tmpdir/cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/c/crowdsec-custom-bouncer/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb’

cdimage.debian.org/mirror/cdimage/snapshot/Debi
100%[====================================================================================================>]
3,25M  10,2MB/s    in 0,3s

2024-06-30 18:16:21 (10,2 MB/s) -
‘./debian-update-12.6.0-amd64-DVD-1.iso.tmpdir/cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/c/crowdsec-custom-bouncer/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb’
saved [3412900/3412900]

*Found 0 of the 1 files required by the template*
Copied input files to temporary file
`debian-update-12.6.0-amd64-DVD-1.iso.tmp' - repeat command and supply
more files to continue

-----------------------------------------------------------------
1 files not found in previous pass,*trying
alternative download locations*:

--2024-06-30 18:16:21--
*https://us.cdimage.debian.org/cdimage/snapshot/Debian/pool/main/c/crowdsec-custom-bouncer/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb*
Resolving us.cdimage.debian.org (us.cdimage.debian.org)...
2001:1b40:5600:ff80:f8ee::1, 78.129.164.123
Connecting to us.cdimage.debian.org
(us.cdimage.debian.org)|2001:1b40:5600:ff80:f8ee::1|:443... connected.
*ERROR: no certificate subject alternative name matches
        requested host name ‘us.cdimage.debian.org’.*
To connect to us.cdimage.debian.org insecurely, use
`--no-check-certificate'.
Skipping object `./debian-update-12.6.0-amd64-DVD-1.iso.tmpdir' (No such
file or directory)
Found 0 of the 1 files required by the template
Copied input files to temporary file
`debian-update-12.6.0-amd64-DVD-1.iso.tmp' - repeat command and supply
more files to continue

-----------------------------------------------------------------
*Aaargh - 1 files could not be downloaded. This should not
happen!* Depending on the problem, it may help to retry downloading
the missing files.
Also, you could try changing to another Debian or Non-US server,
in case the one you used is out of sync.

However, if all the files downloaded without errors and you
still get this message, it means that the files changed on the
server, so the image cannot be generated.
As a last resort, you could try to complete the CD image download
by fetching the remaining data with rsync.

Press Return to retry downloading the missing files.
Press Ctrl-C to abort. (If you re-run jigdo-lite later, it will
resume from here, the downloaded data is not lost if you press
Ctrl-C now.)
: ^C


****@linux-desktop:~/work# jigdo-lite
/root/work/iso/Debian/12.6.0/amd64/jigdo-dvd/debian-update-12.6.0-amd64-DVD-3.jigdo_*

Jigsaw Download "lite"
Copyright (C) 2001-2009  |  jigdo@
Richard Atterer          |  atterer.org
Copyright (C) 2016-2021
Steve McIntyre <***@debian.org>
Loading settings from `/root/.jigdo-lite'

-----------------------------------------------------------------
Images offered by
`/root/work/iso/Debian/12.6.0/amd64/jigdo-dvd/debian-update-12.6.0-amd64-DVD-3.jigdo':
  1: 'Debian GNU/Linux 12.6.0 - Official amd64 12.60->12.6.0 update DVD
#3' (debian-update-12.6.0-amd64-DVD-3.iso)

Further information about `debian-update-12.6.0-amd64-DVD-3.iso':
Generated on Sat, 29 Jun 2024 12:03:06 +0000

-----------------------------------------------------------------
If you already have a previous version of the CD you are
downloading, jigdo can re-use files on the old CD that are also
present in the new image, and you do not need to download them
again. Mount the old CD ROM and enter the path it is mounted under
(e.g. `/mnt/cdrom').
Alternatively, just press enter if you want to start downloading
the remaining files.

You can also enter a single digit from the list below to
select the respective entry for scanning:
  1: /mnt/iso-stable
  2: /mnt/iso-oldstable
Files to scan:

-----------------------------------------------------------------
The jigdo file refers to files stored on Debian mirrors. Please
choose a Debian mirror as follows: Either enter a complete URL
pointing to a mirror (in the form
`ftp://ftp.debian.org/debian/'), or enter any regular expression
for searching through the list of mirrors: Try a two-letter
country code such as `de', or a country name like `United
States', or a server name like `sunsite'.
Debian mirror [http://cdimage.debian.org/mirror/cdimage/snapshot/Debian/]:


-----------------------------------------------------------------
Merging parts from `file:' URIs, if any...
Found 0 of the 1 files required by the template
Copied input files to temporary file
`debian-update-12.6.0-amd64-DVD-3.iso.tmp' - repeat command and supply
more files to continue
--2024-06-30 18:17:13--
*http://cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb*
Resolving cdimage.debian.org (cdimage.debian.org)... 2001:6b0:19::173,
2001:6b0:19::165, 2001:6b0:19::163, ...
Connecting to cdimage.debian.org
(cdimage.debian.org)|2001:6b0:19::173|:80... connected.
HTTP request sent, awaiting response... *302 Found*
Location:
http://saimei.ftp.acc.umu.se/mirror/cdimage/snapshot/Debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb
[following]
--2024-06-30 18:17:13--
http://saimei.ftp.acc.umu.se/mirror/cdimage/snapshot/Debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb
Resolving saimei.ftp.acc.umu.se (saimei.ftp.acc.umu.se)...
2001:6b0:19::138, 194.71.11.138
Connecting to saimei.ftp.acc.umu.se
(saimei.ftp.acc.umu.se)|2001:6b0:19::138|:80... connected.
HTTP request sent, awaiting response... *200 OK*
Length: 4777512 (4,6M) [application/x-debian-package]
Saving to:
‘./debian-update-12.6.0-amd64-DVD-3.iso.tmpdir/cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb’

cdimage.debian.org/mirror/cdimage/snapshot/Debi
100%[====================================================================================================>]
4,56M  13,0MB/s    in 0,4s

2024-06-30 18:17:14 (13,0 MB/s) -
‘./debian-update-12.6.0-amd64-DVD-3.iso.tmpdir/cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb’
saved [4777512/4777512]

Found 0 of the 1 files required by the template
Copied input files to temporary file
`debian-update-12.6.0-amd64-DVD-3.iso.tmp' - repeat command and supply
more files to continue

-----------------------------------------------------------------
1 files not found in previous pass, trying
alternative download locations:

--2024-06-30 18:17:14--
https://us.cdimage.debian.org/cdimage/snapshot/Debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb
Resolving us.cdimage.debian.org (us.cdimage.debian.org)...
2001:1b40:5600:ff80:f8ee::1, 78.129.164.123
Connecting to us.cdimage.debian.org
(us.cdimage.debian.org)|2001:1b40:5600:ff80:f8ee::1|:443... connected.
*ERROR: no certificate subject alternative name matches
        requested host name ‘us.cdimage.debian.org’.*
To connect to us.cdimage.debian.org insecurely, use
`--no-check-certificate'.
Skipping object `./debian-update-12.6.0-amd64-DVD-3.iso.tmpdir' (No such
file or directory)
Found 0 of the 1 files required by the template
Copied input files to temporary file
`debian-update-12.6.0-amd64-DVD-3.iso.tmp' - repeat command and supply
more files to continue

-----------------------------------------------------------------
*Aaargh - 1 files could not be downloaded. This should not
happen!* Depending on the problem, it may help to retry downloading
the missing files.
Also, you could try changing to another Debian or Non-US server,
in case the one you used is out of sync.

However, if all the files downloaded without errors and you
still get this message, it means that the files changed on the
server, so the image cannot be generated.
As a last resort, you could try to complete the CD image download
by fetching the remaining data with rsync.

Press Return to retry downloading the missing files.
Press Ctrl-C to abort. (If you re-run jigdo-lite later, it will
resume from here, the downloaded data is not lost if you press
Ctrl-C now.)
: ^C

[Steve McIntyre]

Hi Matthias!

Post by M. Buecher
Package: cdimage.debian.org
Version: 12.6
Jigdo downloading the update DVDs for Debian 12.6.0 from cdimage.debian.org fails.
Update DVDs #1 and #3 fail to complete due to packages crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb and termshark_2.4.0-1+b6_amd64.deb on http://cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/
When using the German Mirror ftp.de.debian.org then I am able to complete the jigdo download.
So, I checked their SHA256 sums and they differ.
#1 cdimage.debian.org
http://cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/c/crowdsec-custom-bouncer/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb
http://cdimage.debian.org/mirror/cdimage/snapshot/Debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb
b4264c6c0be0cd815580efb85d0ab83d8dd4d4ec270608fadeb619900278216d *cdimage/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb
a1d767d398e205af7eefdf9c3785066c3e5de4b0df922dbab9fb80f98b0ab7be *cdimage/termshark_2.4.0-1+b6_amd64.deb
#2 ftp.de.debian.org
http://ftp.de.debian.org/debian/pool/main/t/termshark/termshark_2.4.0-1+b6_amd64.deb
http://ftp.de.debian.org/debian/pool/main/c/crowdsec-custom-bouncer/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb
5a66c3d47e770f0cba5cf33fe0f24df9810cdab01e1d6421a5a6a41b1049f3f9 *de/crowdsec-custom-bouncer_0.0.15-3+b2_amd64.deb
575632b72bcc8c6666c5cf3b6f9e977a23febfa433e17d096b15513744709729 *de/termshark_2.4.0-1+b6_amd64.deb
Please fix the broken packages on cdimage.debian.org

Thanks for reporting, looking at this now.

[Steve McIntyre]

Post by Steve McIntyre

Post by M. Buecher
Please fix the broken packages on cdimage.debian.org

Thanks for reporting, looking at this now.

Having written a script to fully check the snapshot bits for 12.6, I
found some more files int snapsho that were broken as well as the ones
you listed. I'm not sure exactly how they were broken, but I've
thoroughly checked the complete set of files from 12.6 now.

I've replaced all the broken files and I *believe* all should be good
now; I'm re-running the checker script now to be 100% sure.