Bug#1003014: make_disc_trees.pl misdetects files missing for debootstrap when a proxy is used to retrieve packages - essentially making the installer ignore packages on the CDROM

[Daniel Leidert]

Package: debian-cd
Version: 3.1.35
Severity: normal

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

I was recently building custom images using simple-cdd, and for some reason the
installer was completely ignoring the packages shipped with the media. With
some digging I found the installer reporting:

cdrom-detect: Base system not installable from CD, requesting choose-mirror

With some more digging I found that make_disc_trees.pl was reporting:

5 files missing for debootstrap, not creating base_installable

But the relevant make_disc_tree.log file only contained this at the end:

Missing debootstrap-required I:
Missing debootstrap-required Using
Missing debootstrap-required auto-detected
Missing debootstrap-required proxy:
Missing debootstrap-required http://127.0.0.1:8000/

So actually there were no packages missing. Disabling the proxy then "fixed"
the issue. There were no more complaints by make_disc_trees.pl, and the
installer was using all the package put on the CD.

So we somehow need to ignore messages like the above, which do not indicate
packages missing.

Regards, Daniel



- -- System Information:
Debian Release: bookworm/sid
APT prefers unstable-debug
APT policy: (500, 'unstable-debug'), (500, 'testing-debug'), (500, 'stable-security'), (500, 'stable-debug'), (500, 'unstable'), (500, 'testing'), (500, 'stable'), (1, 'experimental')
Architecture: amd64 (x86_64)

Kernel: Linux 5.15.0-2-amd64 (SMP w/8 CPU threads)
Kernel taint flags: TAINT_OOT_MODULE, TAINT_UNSIGNED_MODULE
Locale: LANG=de_DE.UTF-8, LC_CTYPE=de_DE.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages debian-cd depends on:
ii apt 2.3.13
ii bc 1.07.1-3+b1
ii bzip2 1.0.8-5
ii cpp 4:11.2.0-2
ii curl 7.80.0-3
ii dctrl-tools [grep-dctrl] 2.24-3+b1
ii dpkg-dev 1.21.1
ii genisoimage 9:1.1.11-3.2
pn libcompress-zlib-perl <none>
pn libdigest-md5-perl <none>
ii libdpkg-perl 1.21.1
ii libfile-slurp-perl 9999.32-1
ii libyaml-libyaml-perl 0.83+ds-1
ii lynx 2.9.0dev.10-1
ii make 4.3-4.1
ii perl [libdigest-sha-perl] 5.32.1-6
ii tofrodos 1.7.13+ds-5
ii wget 1.21.2-2+b1
ii xorriso 1.5.4-2

Versions of packages debian-cd recommends:
ii dosfstools 4.2-1
ii hfsutils 3.2.6-15
ii isolinux 3:6.04~git20190206.bf6db5b4+dfsg1-3
ii mtools 4.0.33-1+really4.0.32-1
ii syslinux-common 3:6.04~git20190206.bf6db5b4+dfsg1-3

debian-cd suggests no packages.

- -- no debconf information

[Steve McIntyre]

Hi Daniel, and Happy New Year!

Post by Daniel Leidert
Package: debian-cd
Version: 3.1.35
Severity: normal
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
I was recently building custom images using simple-cdd, and for some reason the
installer was completely ignoring the packages shipped with the media. With
cdrom-detect: Base system not installable from CD, requesting choose-mirror
5 files missing for debootstrap, not creating base_installable
Missing debootstrap-required Using
Missing debootstrap-required auto-detected
Missing debootstrap-required http://127.0.0.1:8000/
So actually there were no packages missing. Disabling the proxy then "fixed"
the issue. There were no more complaints by make_disc_trees.pl, and the
installer was using all the package put on the CD.
So we somehow need to ignore messages like the above, which do not indicate
packages missing.

Argh, OK. That's clearly the apt wrapper getting confused by the extra
output from apt. I'm guessing you have extra environment config to set
up the proxy here?

[Daniel Leidert]

Hi Steve and a Happy New Year to you as well!

Am Donnerstag, dem 06.01.2022 um 11:27 +0000 schrieb Steve McIntyre:

[..]

Post by Steve McIntyre
Argh, OK. That's clearly the apt wrapper getting confused by the extra
output from apt. I'm guessing you have extra environment config to set
up the proxy here?

I run squid-deb-proxy and squid-deb-proxy-client locally, and the latter
installs /etc/apt/apt.conf.d/30autoproxy with the proxy configuration:

Acquire::http::ProxyAutoDetect "/usr/share/squid-deb-proxy-client/apt-avahi-discover";

And on this system I then use simple-cdd to build custom installer images.

Regards, Daniel