d-i netinstall fails due to missing apt-transport-https package

Status changed to 'Confirmed' because the bug affects multiple users.

@Ryan Lovett, did you find a solution to this?

This issue is still present. Has anyone found a fix for this?

Attached is a debdiff for Bionic

Attached is a debdiff for Focal

Attached is a generic patch with proper DEP-3 tagging for use with quilt. Since debootstrap uses "3.0 (native)" instead of "3.0 (quilt)", the previous debdiffs are to be used instead. I am just attaching in the off-chance it is useful.

Verified the netinstall images i.e. initrd.gz and vmlinuz from https://people.canonical.com/~mruffell/sf289200/ work for me, and I am now able to deploy instance

The attachment "Debdiff for Bionic" seems to be a debdiff. The ubuntu-sponsors team has been subscribed to the bug report so that they can review and hopefully sponsor the debdiff. If the attachment isn't a patch, please remove the "patch" flag from the attachment, remove the "patch" tag, and if you are member of the ~ubuntu-sponsors, unsubscribe the team.

[This is an automated message performed by a Launchpad user owned by ~brian-murray, for any issue please contact him.]

The VM on the left is using the current 18.04.4 LTS mini.iso provided from http://archive.ubuntu.com/ubuntu/dists/bionic-updates/main/installer-amd64/current/images/netboot/ with a date of 2020-01-30.

The VM on the right is using the mini.iso I created that contains the test debootstrap package, from https://people.canonical.com/~mruffell/sf289200/

On both, I selected [Advanced Options] and then [Command Line Expert Install]. From there I answered the usual questions. When I was asked to configure the mirror, I selected "https" and then entered in a local mirror in my country, mirror.fsmg.org.nz.

The VM on the left fails with the error message that apt-transport-https can't be found, and stops.
The VM on the right installs the base system fine, and successfully installs the system.

The test packages work. I will ask for my patches to be sponsored and hopefully we can get debootstrap fixed before the 18.04.5 LTS deadline.

Hi Matthew and SRU team,

Performed additional testing for the deboostrap package upload,
checking for regressions in variants (minbase, buildd, default.)

This compares the logs of debootstrap variants in a mirror that
supports both HTTP and HTTPS.

For HTTP: no differences in the logs / no regressions.

For HTTPS: original package fails, patched package works.

Comparing HTTPS/patched vs. HTTP/original: the only differences
are the packages for SSL (ca-certificates, libssl, openssl) and
the mirror URL, of course.

All good!

Mirror
======

Mirror list:
- https://ubuntu.com/download/alternative-downloads (See all Ubuntu mirrors)
- https://launchpad.net/ubuntu/+cdmirrors (find one with 'https' and 'http')

Selected: mirror.math.princeton.edu/pub/ubuntu/

Test Steps
==========

mirror=mirror.math.princeton.edu/pub/ubuntu/

release=bionic # or focal
version=updates # or patched

for protocol in http https; do
  for variant in minbase buildd ''; do
    test=debootstrap-$version-$release-$variant-$protocol
    echo "TEST: $test"

    sudo debootstrap ${variant:+--variant=$variant} $release $test.dir $protocol://$mirror 2>&1 | tee $test.log

  done
done

Then check last line of logs:

$ tail -n1 *-$version-*.log

And compare MD5SUMs / check DIFFs later.

Bionic
======

Original
--------

$ dpkg -s debootstrap | grep Version:
Version: 1.0.95ubuntu0.6

$ tail -n1 *-$version-*.log
==> debootstrap-updates-bionic--http.log <==
I: Base system installed successfully.

==> debootstrap-updates-bionic--https.log <==
E: Couldn't find these debs: apt-transport-https

==> debootstrap-updates-bionic-buildd-http.log <==
I: Base system installed successfully.

==> debootstrap-updates-bionic-buildd-https.log <==
E: Couldn't find these debs: apt-transport-https

==> debootstrap-updates-bionic-minbase-http.log <==
I: Base system installed successfully.

==> debootstrap-updates-bionic-minbase-https.log <==
E: Couldn't find these debs: apt-transport-https

Patched:
-------

$ sudo add-apt-repository ppa:mfo/lp1772556
$ sudo apt update
$ sudo apt install debootstrap

$ dpkg -s debootstrap | grep Version:
Version: 1.0.95ubuntu0.7

$ tail -n1 *-$version-*.log
==> debootstrap-patched-bionic--http.log <==
I: Base system installed successfully.

==> debootstrap-patched-bionic--https.log <==
I: Base system installed successfully.

==> debootstrap-patched-bionic-buildd-http.log <==
I: Base system installed successfully.

==> debootstrap-patched-bionic-buildd-https.log <==
I: Base system installed successfully.

==> debootstrap-patched-bionic-minbase-http.log <==
I: Base system installed successfully.

==> debootstrap-patched-bionic-minbase-https.log <==
I: Base system installed successfully.

Comparison of HTTP protocol for no regressions:
Identical contents (same MD5 Sums), no changes.
---

$ md5sum *-http.log | sort
2b80e8818a86fbc3e245c874f998f427 debootstrap-patched-bionic--http.log
2b80e8818a86fbc3e245c874f998f427 debootstrap-updates-bionic--http.log
5cd140b4e2f6b432cc96c626f20fe180 debootstrap-patched-bionic-buildd-http.log
5cd140b4e2f6b432cc96c626f20fe180 debootstrap-updates-bionic-buildd-http.log
b8aac6c25452d7fd4f6244e4b26a1a58 debootstrap-patched-bionic-minbase-http.log
b8aac6c25452d7fd4f6244e4b26a1a58 debootstrap-updates-bionic-minbase-http.log

Comparison of HTTP/HTTPS for no regressions:
Just add SSL packages and diff mirror URL:
---

release=bionic

for variant in minbase buildd ''; do
  echo "DIFF: patched/https vs. updates/http: variant '$variant'"
  diff -U0 debootstrap-patched-$release-$variant-https.log debootstrap-updates-$release-$variant-http.log
  echo
done

DIFF: patched/https vs. updates/http: variant 'minbase'
--- debootstrap-patched-bionic-minbase-https.log 2020-07-27 14:01:55.065581367 +0000
+++ debootstrap-updates-bionic-minbase-http.log 2020-07-27 13:45:50.028386026 +0000
@@ -8,2 +8,2 @@
-I: Found additional base dependencies: adduser gpgv libapt-pkg5.0 libffi6 libgmp10 libgnutls30 libhogweed4 libidn2-0 libnettle6 libp11-kit$
 libseccomp2 libssl1.1 libstdc++6 libtasn1-6 libunistring2 openssl ubuntu-keyring
-I: Checking component main on https://mirror.math.princeton.edu/pub/ubuntu...
+I: Found additional base dependencies: adduser gpgv libapt-pkg5.0 libffi6 libgmp10 libgnutls30 libhogweed4 libidn2-0 libnettle6 libp11-kit$
 libseccomp2 libstdc++6 libtasn1-6 libunistring2 ubuntu-keyring
+I: Checking component main on http://mirror.math.princeton.edu/pub/ubuntu...
@@ -22,2 +21...

Focal
=====

Original
--------

$ dpkg -s debootstrap | grep Version:
Version: 1.0.118ubuntu1.1

$ tail -n1 *-$version-*.log
==> debootstrap-updates-focal--http.log <==
I: Base system installed successfully.

==> debootstrap-updates-focal--https.log <==
E: Couldn't find these debs: apt-transport-https

==> debootstrap-updates-focal-buildd-http.log <==
I: Base system installed successfully.

==> debootstrap-updates-focal-buildd-https.log <==
E: Couldn't find these debs: apt-transport-https

==> debootstrap-updates-focal-minbase-http.log <==
I: Base system installed successfully.

==> debootstrap-updates-focal-minbase-https.log <==
E: Couldn't find these debs: apt-transport-https

Patched
-------

sudo add-apt-repository ppa:mfo/lp1772556
sudo apt update
sudo apt install debootstrap

$ dpkg -s debootstrap | grep Version:
Version: 1.0.118ubuntu1.2

$ tail -n1 *-$version-*.log
==> debootstrap-patched-focal--http.log <==
I: Base system installed successfully.

==> debootstrap-patched-focal--https.log <==
I: Base system installed successfully.

==> debootstrap-patched-focal-buildd-http.log <==
I: Base system installed successfully.

==> debootstrap-patched-focal-buildd-https.log <==
I: Base system installed successfully.

==> debootstrap-patched-focal-minbase-http.log <==
I: Base system installed successfully.

==> debootstrap-patched-focal-minbase-https.log <==
I: Base system installed successfully.

Comparison of HTTP protocol for no regressions:
Identical contents (same MD5 Sums), no changes.
---

$ md5sum *-http.log | sort
55adb44ba484d60cb12e9e30e417b73d debootstrap-patched-focal-buildd-http.log
55adb44ba484d60cb12e9e30e417b73d debootstrap-updates-focal-buildd-http.log
78db31fc39808298649cfb3c384298f4 debootstrap-patched-focal-minbase-http.log
78db31fc39808298649cfb3c384298f4 debootstrap-updates-focal-minbase-http.log
f20f0050ab281c2a77b61e5aa91c5b10 debootstrap-patched-focal--http.log
f20f0050ab281c2a77b61e5aa91c5b10 debootstrap-updates-focal--http.log

Comparison of HTTP/HTTPS for no regressions:
Just add SSL packages and diff mirror URL:
---

release=focal

for variant in minbase buildd ''; do
  echo "DIFF: patched/https vs. updates/http: variant '$variant'"
  diff -U0 debootstrap-patched-$release-$variant-https.log debootstrap-updates-$release-$variant-http.log
  echo
done

DIFF: patched/https vs. updates/http: variant 'minbase'
--- debootstrap-patched-focal-minbase-https.log 2020-07-27 14:38:17.935977579 +0000
+++ debootstrap-updates-focal-minbase-http.log 2020-07-27 14:22:26.222344378 +0000
@@ -8 +8 @@
-I: Checking component main on https://mirror.math.princeton.edu/pub/ubuntu...
+I: Checking component main on http://mirror.math.princeton.edu/pub/ubuntu...
@@ -21,2 +20,0 @@
-I: Retrieving ca-certificates 20190110ubuntu1
-I: Validating ca-certificates 20190110ubuntu1
@@ -143,2 +140,0 @@
-I: Retrieving libssl1.1 1.1.1f-1ubuntu2
-I: Validating libssl1.1 1.1.1f-1ubuntu2
@@ -175,2 +170,0 @@
-I: Retrieving openssl 1.1.1f-1ubuntu2
-I: Validating openssl 1.1.1f-1ubuntu2
@@ -430 +423,0 @@
-I: Unpacking ca-certificates...
@@ -441 +433,0 @@
-I: Unpacking libssl1.1:amd64...
@@ -445 +436,0 @@
-I: Unpacking openssl...
@@ -449 +439,0 @@
-...

Uploaded debootstrap to Bionic/Focal. Thanks!

Hello Ryan, or anyone else affected,

Accepted debootstrap into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/debootstrap/1.0.118ubuntu1.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Hello Ryan, or anyone else affected,

Accepted debootstrap into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/debootstrap/1.0.95ubuntu0.7 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

All autopkgtests for the newly accepted debootstrap (1.0.95ubuntu0.7) for bionic have finished running.
The following regressions have been reported in tests triggered by the package:

pbuilder/0.229.1 (ppc64el, i386, amd64, arm64, s390x)
sbuild/0.75.0-1ubuntu1 (ppc64el, amd64, arm64, s390x)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/bionic/update_excuses.html#debootstrap

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

All autopkgtests for the newly accepted debootstrap (1.0.118ubuntu1.2) for focal have finished running.
The following regressions have been reported in tests triggered by the package:

livecd-rootfs/2.664.4 (s390x, amd64, ppc64el, arm64)
sbuild/0.79.0-1ubuntu1 (s390x, amd64, ppc64el, arm64)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/focal/update_excuses.html#debootstrap

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

I looked into the autopkgtest regressions.

The pbuilder and sbuilder failures are due to them attempting to build procenv in a Groovy chroot which was made with debootstrap. procenv currently FTBFS on Groovy, due to changes in GCC10 to -Werror=format-overflow.

```
gcc -DHAVE_CONFIG_H -I. -I.. -I . -I ./platform -I ./platform/linux -D PROCENV_PLATFORM_LINUX -pedantic -std=gnu99 -Wall -Wunused -fstack-protector -Wformat -fdata-sections -ffunction-sections -Werror -g -O2 -MT platform/linux/procenv-platform.o -MD -MP -MF platform/linux/.deps/procenv-platform.Tpo -c -o platform/linux/procenv-platform.o `test -f 'platform/linux/platform.c' || echo './'`platform/linux/platform.c
platform/linux/platform.c: In function ‘handle_proc_branch_linux’:
platform/linux/platform.c:1266:21: error: ‘%s’ directive writing up to 1017 bytes into a region of size 16 [-Werror=format-overflow=]
 1265 | p += 1+strlen ("Name:"); /* jump over tab char */
      | ~~~~~~~~~~~~~~~~~~~~~~~
 1266 | sprintf (name, "%s", p);
      | ^~
In file included from /usr/include/stdio.h:867,
                 from ./platform.h:22,
                 from platform/linux/platform-linux.h:25,
                 from platform/linux/platform.c:19:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:36:10: note: ‘__builtin___sprintf_chk’ output between 1 and 1018 bytes into a destination of size 16
   36 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1,
      | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   37 | __bos (__s), __fmt, __va_arg_pack ());
      | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
platform/linux/platform.c:1271:21: error: ‘%s’ directive writing up to 1017 bytes into a region of size 16 [-Werror=format-overflow=]
 1270 | p += 1+strlen ("PPid:"); /* jump over tab char */
      | ~~~~~~~~~~~~~~~~~~~~~~~
 1271 | sprintf (ppid, "%s", p);
      | ^~
In file included from /usr/include/stdio.h:867,
                 from ./platform.h:22,
                 from platform/linux/platform-linux.h:25,
                 from platform/linux/platform.c:19:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:36:10: note: ‘__builtin___sprintf_chk’ output between 1 and 1018 bytes into a destination of size 16
   36 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1,
      | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   37 | __bos (__s), __fmt, __va_arg_pack ());
      | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

```

This has nothing to do with the changes made to debootstrap.

Looking at the changelog for procenv, this has happened before...

procenv (0.50-1ubuntu2) eoan; urgency=medium

  * Hack it so it ignores broken gcc overflow warnings on ppc64el
  * Stop mv README in debian/rules, that breaks building twice (it's a symlink already)

 -- Julian Andres Klode <email address hidden> Mon, 05 Aug 2019 13:43:53 +0200

procenv (0.50-1ubuntu1) eoan; urgency=medium

  * debian/patches/gcc-9-strncpy.patch: Handle strncpy in a way
    compatible with gcc-9 linting.

 -- Steve Langasek <email address hidden> Sat, 20 Jul 2019 17:30:12 +0000

Regardless, ...

Performing verification of debootstrap in -proposed using Mauricio's script from comment #10.

Bionic
======

Original
--------

First, using debootstrap from -updates:

$ apt-cache policy debootstrap | grep Installed
Installed: 1.0.95ubuntu0.6

$ tail -n1 *-bionic-*.log
==> debootstrap-updates-bionic-buildd-http.log <==
I: Base system installed successfully.

==> debootstrap-updates-bionic-buildd-https.log <==
E: Couldn't find these debs: apt-transport-https

==> debootstrap-updates-bionic--http.log <==
I: Base system installed successfully.

==> debootstrap-updates-bionic--https.log <==
E: Couldn't find these debs: apt-transport-https

==> debootstrap-updates-bionic-minbase-http.log <==
I: Base system installed successfully.

==> debootstrap-updates-bionic-minbase-https.log <==
E: Couldn't find these debs: apt-transport-https

Proposed
--------

I then enabled -proposed and upgraded debootstrap:

$ apt-cache policy debootstrap | grep Installed
  Installed: 1.0.95ubuntu0.7

I then re-ran the script.

$ tail -n1 *-proposed-*.log
==> debootstrap-proposed-bionic-buildd-http.log <==
I: Base system installed successfully.

==> debootstrap-proposed-bionic-buildd-https.log <==
I: Base system installed successfully.

==> debootstrap-proposed-bionic--http.log <==
I: Base system installed successfully.

==> debootstrap-proposed-bionic--https.log <==
I: Base system installed successfully.

==> debootstrap-proposed-bionic-minbase-http.log <==
I: Base system installed successfully.

==> debootstrap-proposed-bionic-minbase-https.log <==
I: Base system installed successfully.

Checking the MD5 sums Mauricio checked for HTTP protocol to check same packages
were downloaded:

$ md5sum *-http.log | sort
11053db4e85763e38002dcf56ea9caec debootstrap-proposed-bionic-buildd-http.log
11053db4e85763e38002dcf56ea9caec debootstrap-updates-bionic-buildd-http.log
2130bc2842b6d8ff142b11d428cc95b6 debootstrap-proposed-bionic--http.log
2130bc2842b6d8ff142b11d428cc95b6 debootstrap-updates-bionic--http.log
7078e5287b2f3f9b8566a48ed5bd53fb debootstrap-proposed-bionic-minbase-http.log
7078e5287b2f3f9b8566a48ed5bd53fb debootstrap-updates-bionic-minbase-http.log

Hashes match.

Checking package diffs between http and https:

DIFF: proposed/https vs. updates/http: variant 'minbase'
--- debootstrap-proposed-bionic-minbase-https.log 2020-07-28 17:18:34.918486033 +1200
+++ debootstrap-updates-bionic-minbase-http.log 2020-07-28 16:41:46.426251359 +1200
@@ -8,2 +8,2 @@
-I: Found additional base dependencies: adduser gpgv libapt-pkg5.0 libffi6 libgmp10 libgnutls30 libhogweed4 libidn2-0 libnettle6 libp11-kit0 libseccomp2 libssl1.1 libstdc++6 libtasn1-6 libunistring2 openssl ubuntu-keyring
-I: Checking component main on https://mirror.fsmg.org.nz/ubuntu...
+I: Found additional base dependencies: adduser gpgv libapt-pkg5.0 libffi6 libgmp10 libgnutls30 libhogweed4 libidn2-0 libnettle6 libp11-kit0 libseccomp2 libstdc++6 libtasn1-6 libunistring2 ubuntu-keyring
+I: Checking component main on http://mirror.fsmg.org.nz/ubuntu...
@@ -22,2 +21,0 @@
-I: Retrieving ca-certificates 20180409
-I: Validating ca-certificates 20180409
@@ -140,2 +137,0 @@
-I: Retrieving libssl1.1 1.1.0g-2ubuntu4...

Performing verification of debootstrap using Mauricio's script from comment #10.

Focal
======

Original
--------

First, using debootstrap from -updates:

$ apt-cache policy debootstrap | grep Installed
Installed: 1.0.118ubuntu1.1

$ tail -n1 *-focal-*.log
==> debootstrap-updates-focal-buildd-http.log <==
I: Base system installed successfully.

==> debootstrap-updates-focal-buildd-https.log <==
E: Couldn't find these debs: apt-transport-https

==> debootstrap-updates-focal--http.log <==
I: Base system installed successfully.

==> debootstrap-updates-focal--https.log <==
E: Couldn't find these debs: apt-transport-https

==> debootstrap-updates-focal-minbase-http.log <==
I: Base system installed successfully.

==> debootstrap-updates-focal-minbase-https.log <==
E: Couldn't find these debs: apt-transport-https

Proposed
--------

I then enabled -proposed and upgraded debootstrap:

$ apt-cache policy debootstrap | grep Installed
Installed: 1.0.118ubuntu1.2

I then re-ran the script.

$ tail -n1 *-proposed-*.log
==> debootstrap-proposed-focal-buildd-http.log <==
I: Base system installed successfully.

==> debootstrap-proposed-focal-buildd-https.log <==
I: Base system installed successfully.

==> debootstrap-proposed-focal--http.log <==
I: Base system installed successfully.

==> debootstrap-proposed-focal--https.log <==
I: Base system installed successfully.

==> debootstrap-proposed-focal-minbase-http.log <==
I: Base system installed successfully.

==> debootstrap-proposed-focal-minbase-https.log <==
I: Base system installed successfully.

Checking the MD5 sums Mauricio checked for HTTP protocol to check same packages
were downloaded:

$ md5sum *-http.log | sort
4421a481335f470fe3cba85f9d56ddfd debootstrap-proposed-focal-buildd-http.log
4421a481335f470fe3cba85f9d56ddfd debootstrap-updates-focal-buildd-http.log
828dc970b0c8b3ef523ac0dfd82b6dea debootstrap-proposed-focal--http.log
828dc970b0c8b3ef523ac0dfd82b6dea debootstrap-updates-focal--http.log
a3d4733c73de32fb8dd0828eedeedc5d debootstrap-proposed-focal-minbase-http.log
a3d4733c73de32fb8dd0828eedeedc5d debootstrap-updates-focal-minbase-http.log

Hashes match.

Checking package diffs between http and https:

DIFF: proposed/https vs. updates/http: variant 'minbase'
--- debootstrap-proposed-focal-minbase-https.log 2020-07-28 17:54:19.793873364 +1200
+++ debootstrap-updates-focal-minbase-http.log 2020-07-28 17:30:15.887212891 +1200
@@ -8 +8 @@
-I: Checking component main on https://mirror.fsmg.org.nz/ubuntu...
+I: Checking component main on http://mirror.fsmg.org.nz/ubuntu...
@@ -21,2 +20,0 @@
-I: Retrieving ca-certificates 20190110ubuntu1
-I: Validating ca-certificates 20190110ubuntu1
@@ -143,2 +140,0 @@
-I: Retrieving libssl1.1 1.1.1f-1ubuntu2
-I: Validating libssl1.1 1.1.1f-1ubuntu2
@@ -175,2 +170,0 @@
-I: Retrieving openssl 1.1.1f-1ubuntu2
-I: Validating openssl 1.1.1f-1ubuntu2
@@ -430 +423,0 @@
-I: Unpacking ca-certificates...
@@ -441 +433,0 @@
-I: Unpacking libssl1.1:amd64...
@@ -445 +436,0 @@
-I: Unpacking openssl...
@@ -449 +439,0 @@
-I: Configuring libssl1.1:amd64...
@@ -460 +449,0 @@
-I: Configuring openssl...
@@ -463 +451,0 @@
-I: Configuring ca-certificates...
@@ -468 +455,0 @@
-...

In addition to comment #18 that explains why the autopkgtests failures are unrelated,
I triggered re-runs with debootstrap package in -updates, which hits the same errors.

Thus confirming this is not a regression with debootstrap in -proposed.

cheers,
Mauricio

pbuilder/bionic

 https://autopkgtest.ubuntu.com/packages/p/pbuilder/bionic/amd64
 0.229.1 debootstrap/1.0.95ubuntu0.6 2020-07-28 13:16:37 UTC 0h 03m 04s mfo fail
 0.229.1 debootstrap/1.0.95ubuntu0.7 2020-07-27 18:11:40 UTC 0h 16m 09s - fail

sbuild/bionic

 https://autopkgtest.ubuntu.com/packages/s/sbuild/bionic/amd64
 0.75.0-1ubuntu1 debootstrap/1.0.95ubuntu0.6 2020-07-28 13:17:32 UTC 0h 03m 43s mfo fail
 0.75.0-1ubuntu1 debootstrap/1.0.95ubuntu0.7 2020-07-27 18:11:21 UTC 0h 13m 29s - fail

sbuild/focal

 https://autopkgtest.ubuntu.com/packages/s/sbuild/focal/amd64
 0.79.0-1ubuntu1 debootstrap/1.0.118ubuntu1.1 2020-07-28 13:17:29 UTC 0h 03m 04s mfo fail
 0.79.0-1ubuntu1 debootstrap/1.0.118ubuntu1.2 2020-07-27 18:16:24 UTC 0h 05m 15s - fail

livecd-rootfs/focal

 https://autopkgtest.ubuntu.com/packages/l/livecd-rootfs/focal/amd64
 2.664.4 debootstrap/1.0.118ubuntu1.1 2020-07-28 13:39:58 UTC 0h 25m 42s mfo fail
 2.664.4 debootstrap/1.0.118ubuntu1.2 2020-07-27 18:34:05 UTC 0h 37m 23s - fail

As a final sanity check, I built a new debian-installer monolithic netinstall ISO image, along with the usual vmlinuz / initrd.gz files. When I built them, I enabled -proposed, and debootstrap-udeb 1.0.95ubuntu0.7 was included in the generated MANIFEST.udeb file.

The ISO images and initrd.gz files are here:
https://people.canonical.com/~mruffell/sf289200-proposed/

I did a test install with the mini.iso image, selecting [Advanced Install] then [Command Line Expert Install]. When it asked for package mirrors, I selected https, and used a local mirror that supports https, mirror.fsmg.org.nz.

The install worked as expected with no errors. I checked /etc/apt/sources.list in the installed system, and all the apt sources pointed to
deb https://mirror.fsmg.org.nz/ubuntu/ bionic main

The package in -proposed fixes the problem, and works with https mirrors.

Fixed in debootstrap 1.0.120 and later.

I will be conditionally releasing the bionic upload before focal as focal is currently in 20.04.1 release freeze. We will push it there once we're out with 20.04.1

This bug was fixed in the package debootstrap - 1.0.95ubuntu0.7

---------------
debootstrap (1.0.95ubuntu0.7) bionic; urgency=medium

  * scripts/gutsy, scripts/debian-common: Check codename for
    apt-transport-https as it's in universe as of bionic and
    is no longer needed as functionality is built into apt
    (LP: #1772556)

 -- Matthew Ruffell <email address hidden> Wed, 22 Jul 2020 12:25:46 +1200

The verification of the Stable Release Update for debootstrap has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

The autopkgtests failures for sbuild on focal-proposed
are all addressed/passed; the Pending SRU page is clear
for focal/deboostrap. [1]

Thanks @mruffell for the ping to re-trigger the sbuild
failed tests (that debootstrap groovy) now that groovy's
procenv has the fix for GCC 10.

cheers,
Mauricio

[1] https://people.canonical.com/~ubuntu-archive/pending-sru.html

This bug was fixed in the package debootstrap - 1.0.118ubuntu1.2

---------------
debootstrap (1.0.118ubuntu1.2) focal; urgency=medium

  * scripts/gutsy, scripts/debian-common: Check codename for
    apt-transport-https as it's in universe as of bionic and
    is no longer needed as functionality is built into apt
    (LP: #1772556)

 -- Matthew Ruffell <email address hidden> Wed, 22 Jul 2020 12:38:26 +1200