Hirsute: Cannot install ubuntu-desktop due to unmet dependencies

Status changed to 'Confirmed' because the bug affects multiple users.

Re: "I could not find any information what "phased 20%" means."
https://wiki.ubuntu.com/StableReleaseUpdates#Phasing
https://discourse.ubuntu.com/t/phased-updates-in-apt-in-21-04/20345

A workaround is to manually force installation of the dependencies with the newer "phased" versions:
apt install ubuntu-release-upgrader-core=1:21.04.11 python3-distupgrade=1:21.04.11

Manfred: Thanks! (Offtopic: I googled "apt phased 20%". The "20%" seems to throw Google off completely, it didn't show ANY results related to Linux. Leaving off the 20% yields much better results ;))

OK, so what's going on is that ubuntu-release-upgrader-gtk is not installed, and apt only updates phasing to upgrades, but not new installs. Which fails in this case. Presumably it needs to apply phasing to all packages in a source package if one of them is installed, but that might be slow :(

Or we phase _everything_. Also makes code faster

This bug was fixed in the package apt - 2.3.5

---------------
apt (2.3.5) experimental; urgency=medium

  * policy: Apply phasing to uninstalled packages too (LP: #1925745)

 -- Julian Andres Klode <email address hidden> Mon, 17 May 2021 11:43:23 +0200

This appears to also be affecting the systemd packages on hirsute at the moment.

The following packages have unmet dependencies:
 libsystemd-dev : Depends: libsystemd0 (= 247.3-3ubuntu3.1) but 247.3-3ubuntu3 is to be installed

Attempting to force an install at version ubuntu3.1 offers to remove init :) and triggers the 'do as I say' behavior.

Hello Marian, or anyone else affected,

Accepted apt into hirsute-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/apt/2.2.4ubuntu0.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-hirsute to verification-done-hirsute. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-hirsute. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

I attempted to verify.
Verification summary - inconclusive

Steps performed
1. Create container - lxc launch images:ubuntu/hirsute
2. do steps 1 & 2 in https://wiki.ubuntu.com/QATeam/PerformingSRUVerification
   $ dpkg -l apt
[...]
ii apt 2.2.3 amd64 commandline package manager
3. Follow test case, which says:
   'At the moment, installing libsystemd-dev would trigger it.'
4. libsystemd-dev passes, which does not match expectations.

I believe another package is now necessary to trigger the desired test.

All autopkgtests for the newly accepted apt (2.2.4ubuntu0.1) for hirsute have finished running.
The following regressions have been reported in tests triggered by the package:

ubuntu-advantage-tools/unknown (amd64, ppc64el, s390x, armhf)
reprotest/0.7.16 (arm64)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/hirsute/update_excuses.html#apt

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

This caused a regression in autopkgtest, causing the ubuntu-advantage-tools failure. We'll have to SRU an autopkgtest that sets always-include-phased-updates as in https://salsa.debian.org/ci-team/autopkgtest/-/merge_requests/125

Similar to what Dan wrote in comment #10, my original test case of installing ubuntu-desktop now works even without enabling the proposed repository. So unfortunately I cannot verify the fix now since I cannot reproduce the original error.

We do not have any updates phasing in hirsute atm, so will have to hack in one :)

Verification done.

First I downgraded all systemd packages to the release pocket using

# apt install '?installed?version(247.3-3ubuntu3.1$)=247.3-3ubuntu3'

Then I hacked in Phased-Update-Percentage: 0 fields for all src:systemd packages in my local hirsute-updates Packages file in /var/lib/apt/lists using vim, resulting in

# apt install libsystemd-dev
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 libsystemd-dev : Depends: libsystemd0 (= 247.3-3ubuntu3.1) but 247.3-3ubuntu3 is to be installed
E: Unable to correct problems, you have held broken packages.

I upgraded libapt-pkg6.0 to 2.2.4ubuntu0.1, yielding

root@h:~# apt install libsystemd-dev
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following package was automatically installed and is no longer required:
  libfreetype6
Use 'apt autoremove' to remove it.
The following NEW packages will be installed:
  libsystemd-dev
0 upgraded, 1 newly installed, 0 to remove and 1 not upgraded.
Need to get 299 kB of archives.
After this operation, 1153 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu hirsute/main amd64 libsystemd-dev amd64 247.3-3ubuntu3 [299 kB]
Fetched 299 kB in 0s (2408 kB/s)
Selecting previously unselected package libsystemd-dev:amd64.
(Reading database ... 32918 files and directories currently installed.)
Preparing to unpack .../libsystemd-dev_247.3-3ubuntu3_amd64.deb ...
Unpacking libsystemd-dev:amd64 (247.3-3ubuntu3) ...
Setting up libsystemd-dev:amd64 (247.3-3ubuntu3) ...
Processing triggers for man-db (2.9.4-2) ...
Scanning processes...
Scanning candidates...

Yay!

Phasing back to 100 made it upgrade to -updates as expected:

root@h:~# sed -i "s#Phased-Update-Percentage: 0#Phased-Update-Percentage: 100#g" /var/lib/apt/lists/archive.ubuntu.com_ubuntu_dists_hirsute-updates_main_binary-amd64_Packages
root@h:~# apt install libsystemd-dev
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following package was automatically installed and is no longer required:
  libfreetype6
Use 'apt autoremove' to remove it.
The following additional packages will be installed:
  libnss-systemd libpam-systemd libsystemd0 systemd systemd-sysv systemd-timesy...

autopkgtest SRUs are in bug 1934100

Ok, the autopkgtest regression now fixed and released, let's unblock.

This bug was fixed in the package apt - 2.2.4ubuntu0.1

---------------
apt (2.2.4ubuntu0.1) hirsute; urgency=medium

  * Merge 2.2.4 from Debian unstable
  * Extend the JSON hook fixes with support for version 0.2 (LP: #1926150)
    - json: Add origins fields to version
    - upgrade: Add JSON hook support (AptCli::Hooks::Upgrade)
    - json: Add `package-list` and `statistics` install hooks
    - json: Hook protocol 0.2 (added upgrade,downgrade,reinstall modes)

apt (2.2.4) unstable; urgency=medium

  [ Julian Andres Klode ]
  * Various bugfixes to the JSON hooks:
    - encoder fixes:
      + json: Escape strings using \u escape sequences, add test
      + json: Actually pop states
      + json: Encode NULL strings as null
    - json: Flush standard file descriptors before calling hooks
      (this avoids output from hooks in middle of apt output)
    - Non-installed JSON changes:
      + test/json: Make the test hook more reliable
      + Fix a typo in json-hooks-protocol.md (thanks to Brian Murray)
  * Avoid infinite loop on EOF on media change prompt (LP: #1928687)
  * Turn TLS handshake issues into transient errors (LP: #1928100),
    this makes behavior consistent with TCP and enables Acquire::Retries
  * policy: Apply phasing to uninstalled packages too (LP: #1925745),
    this prevents inconsistencies when installing new binaries that depend
    on the same version of an already installed binary.

  [ David Kalnischkies ]
  * URI encode Filename field of Packages files (again). This fixes a
    regression introduced in 2.1.15 that causes download failures of
    packages with an epoch included in their filename (LP: #1931874).

 -- Julian Andres Klode <email address hidden> Mon, 14 Jun 2021 16:27:40 +0200

The verification of the Stable Release Update for apt has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.