sru curtin 2020-05-27 - 20.1-0ubuntu1

Bug #1881003 reported by Ryan Harper
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
curtin (Ubuntu)
Fix Released
Undecided
Unassigned
Xenial
Fix Released
Undecided
Unassigned
Bionic
Fix Released
Undecided
Unassigned
Focal
Fix Released
Undecided
Unassigned

Bug Description

== Begin SRU Template ==
[Impact]
This release sports both bug-fixes and new features and we would like to
make sure all of our supported customers have access to these improvements.

See the changelog entry below for a full list of changes and bugs.

[Test Case]
The following development and SRU process was followed:
https://wiki.ubuntu.com/CurtinUpdates

Curtin now contains an extensive integration test suite that is ran using
the SRU package for each releases. These suite has documentation here:
https://curtin.readthedocs.io/en/latest/topics/integration-testing.html

In order to avoid regression to existing MAAS product, the MAAS team will
run their continuous integration test against the curtin that is in
-proposed. A successful run will be required before the proposed curtin
can be let into -updates.

The curtin team will be in charge of attaching the artifacts and console
output of the appropriate run to the bug. Curtin team members will not
mark ‘verification-done’ until this has happened.

[Regression Potential]
In order to mitigate the regression potential, the results of the
aforementioned integration tests are attached to this bug.

== End SRU Template ==
* New upstream snapshot. (LP: #1881003)
- vmtests: update skiptests
- vmtest: allow installed centos images to reboot (LP: #1881011)
- Release 20.1 (LP: #1880741)
- Handle multiple separators which were found in TestAllindata vmtest
- verify_ptable_flag: dos primary partitions use ptable_uuid map for flag
  (LP: #1878890)
- net_meta: add disabled mode to skip writing any network config
  [Lucas Moura]
- vmtest: trigger guest panic to fail fast
- Replace grub-shell-helper with install_grub command
- vmtest-sync-images: update the URL of the maas streams [Paride Legovini]
- Replace references to old team manager with new team manager
  [James Falcon]
- tox: pin flake8 to version and add a tip-flake8 environment
  [Paride Legovini]
- Fix flake8 E741 warning [Lucas Moura]
- Makefile: make adjustments to call lint/style tools via python module
- block-discover: ignore invalid id_serial/id_wwn values (LP: #1876848)
- Fix handing of reusing msdos partitions and flags (LP: #1875903)
- block.detect_multipath: ignore fake "devices" from /proc/mounts
  [Michael Hudson-Doyle] (LP: #1876626)
- udev: use shlex.quote when shlex.split errors on shell-escape chars
  (LP: #1875085)
- lvm: don't use vgscan --mknodes
- vmtest: rsync don't cross filesystem boundaries when copying
  (LP: #1873909)
- vmtest: basic/basic_scsi adjust collect/tests for unstable device names
  (LP: #1874100)
- Add unittests for partition_handler calc_[dm]_part_info and kpartx paths
- multipath: attempt to enforce /dev/mapper/mpath files are symlinks
- block-meta: device mapper partitions may be block devices not links
- Default to dm_name being id if empty earlier in dm_crypt_handler()
  [Łukasz 'sil2100' Zemczak] (LP: #1874243)
- storage: correct declared schema draft version for storage schema
- test_clear_holders: add missing zfs mock
- Mock out zfs_supported to prevent attempting to load kernel modules
- block-meta: skip wipe device paths if not present (LP: #1869075)
- unittest: do not allow util.subp by default (LP: #1873913)
- curthooks: support multiple ESP on UEFI bootable systems
- block-discover: handle missing multipath 'path' data, use DM_NAME
  (LP: #1873728)
- lvm-over-multipath: handle lookups of multipath members (LP: #1869075)
- block-meta: don't filter preserve=true devices, select by wipe
  (LP: #1837214)
- vmtest: basic use dname to lookup disk with multiple partitions
- block-meta: Don't check the ptable type of a disk with no ptable
- curthooks: always use ChrootableTarget.subp when calling efibootmgr
- storage: enable and use multipath during storage configuration
  (LP: #1869075)
- block-discover: detect nvme multipath devices (LP: #1868109)
- clear-holders: Tolerate vgchange errors during discovery (LP: #1870037)
- block-meta: handle preserve with vtoc ptable (LP: #1871158)
- vmtest: use -partition file for TestReuseRAIDMemberPartition class
- format: extra_options should be a list type
- tox: add pyflakes to the default tox run [Paride Legovini]
- storage_config: Add 'extra_options' parameter to allow custom mkfs
  (LP: #1869069)
- Add support for installing Ubuntu Core 20 images
- tox.ini: Fix issues with newer tox on focal
- vmtest: Fix test_basic.py to run on s390x (LP: #1866663)
- vmtest: use util.load_file for loading collect files
- block-meta: refactor storage_config preserve and wipe settings
  (LP: #1837214)
- block-discover: skip 'multipath' key in blockdevice if mpath name is None
- tox: all py27 environments should use the base py27 deps
- uefi: refactor efibootmg handling to support removing duplicate entries
  (LP: #1864257)
- tox: pin setuptools < 45 to allow installing py27 in virtenv
- block-discover: add dasd parser and emit dasd storage config
  (LP: #1862849)

Ryan Harper (raharper)
description: updated
Revision history for this message
Brian Murray (brian-murray) wrote : Please test proposed package

Hello Ryan, or anyone else affected,

Accepted curtin into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/curtin/20.1-2-g42a9667f-0ubuntu1~20.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in curtin (Ubuntu Focal):
status: New → Fix Committed
tags: added: verification-needed verification-needed-focal
Revision history for this message
Brian Murray (brian-murray) wrote :

Ubuntu 19.10 does not reach end of life until another 6 weeks or so. Is there a reason curtin was not uploaded for it?

Changed in curtin (Ubuntu Bionic):
status: New → Fix Committed
tags: added: verification-needed-bionic
Revision history for this message
Brian Murray (brian-murray) wrote :

Hello Ryan, or anyone else affected,

Accepted curtin into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/curtin/20.1-2-g42a9667f-0ubuntu1~18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in curtin (Ubuntu Xenial):
status: New → Fix Committed
tags: added: verification-needed-xenial
Revision history for this message
Brian Murray (brian-murray) wrote :

Hello Ryan, or anyone else affected,

Accepted curtin into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/curtin/20.1-2-g42a9667f-0ubuntu1~16.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Chad Smith (chad.smith)
Changed in curtin (Ubuntu):
status: New → In Progress
Revision history for this message
John George (jog) wrote :

Solutions-QA has completed our validation using python3-curtin_20.1-2-g42a9667f-0ubuntu1~18.04.1.
Deployment artifacts are available here:
https://solutions.qa.canonical.com/#/testplans/testplaninstance/5c3995e7-6595-414a-9894-885fb0f54748

tags: added: verification-done-bionic
removed: verification-needed-bionic
Revision history for this message
Dan Watkins (oddbloke) wrote :

Two runs of curtin's CI were performed for xenial: the first, our regular Jenkins run had some tests fail due to bugs in the test code (that have since been fixed upstream), so the second reruns the upstream test code for those tests against the -proposed package.

Revision history for this message
Dan Watkins (oddbloke) wrote :
Revision history for this message
Dan Watkins (oddbloke) wrote :
Revision history for this message
Dan Watkins (oddbloke) wrote :

Three runs of curtin's CI were performed for bionic: the first, our regular Jenkins run had some tests fail due to bugs in the test code (that have since been fixed upstream), so the second reruns the upstream test code for those tests against the -proposed package. This second run had some failures shared with the first run due to a kernel bug (https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1825413), so a third run of those tests was performed on my desktop.

Revision history for this message
Dan Watkins (oddbloke) wrote :
Revision history for this message
Dan Watkins (oddbloke) wrote :
Revision history for this message
Dan Watkins (oddbloke) wrote :
Revision history for this message
Dan Watkins (oddbloke) wrote :
Revision history for this message
Dan Watkins (oddbloke) wrote :
Revision history for this message
Łukasz Zemczak (sil2100) wrote :

What is the state of this upload? I only see the bionic verification tag, and some comments mentioning verification of xenial as well. What about focal? Can someone set the tags appropriately once the verification is finished?

Revision history for this message
John George (jog) wrote :

Solutions-QA completed validation using python3-curtin_20.1-2-g42a9667f from maas to deploy kubernetes on focal. Deployment artifacts are available here:
https://solutions.qa.canonical.com/#/testplans/testplaninstance/5c3995e7-6595-414a-9894-885fb0f54748

Revision history for this message
Brian Murray (brian-murray) wrote :

It'd be helpful if somebody could definitively say they have verified this for xenial and focal and set the tags appropriately.

Revision history for this message
Richard Harding (rharding) wrote :

We were originally waiting to get a Solutions QA verification for Xenial however they are not able to perform those tests any longer. Given that we're submitting with the CI and other testing attached to the bug. I'm updating Xenial as verified.

tags: added: verification-done-xenial
removed: verification-needed-xenial
Revision history for this message
Dan Watkins (oddbloke) wrote :

Currently our focal Jenkins jobs for curtin are failing due to an unrelated issue, so two manual runs of curtin's CI were performed for focal: the first had some tests fail due to bugs in the test code (that have since been fixed upstream), so the second reruns the upstream test code for those tests against the -proposed package.

Revision history for this message
Dan Watkins (oddbloke) wrote :
Revision history for this message
Dan Watkins (oddbloke) wrote :
description: updated
description: updated
tags: added: verification-done verification-done-focal
removed: verification-needed verification-needed-focal
Revision history for this message
Dan Watkins (oddbloke) wrote :

We have now completed SRU verification across all releases.

Revision history for this message
Launchpad Janitor (janitor) wrote :
Download full text (3.7 KiB)

This bug was fixed in the package curtin - 20.1-2-g42a9667f-0ubuntu1~20.04.1

---------------
curtin (20.1-2-g42a9667f-0ubuntu1~20.04.1) focal; urgency=medium

  * New upstream snapshot. (LP: #1881003)
    - vmtests: update skiptests
    - vmtest: allow installed centos images to reboot
    - Release 20.1
    - Handle multiple separators which were found in TestAllindata vmtest
    - verify_ptable_flag: dos primary partitions use ptable_uuid map for flag
    - net_meta: add disabled mode to skip writing any network config
      [Lucas Moura]
    - vmtest: trigger guest panic to fail fast
    - Replace grub-shell-helper with install_grub command
    - vmtest-sync-images: update the URL of the maas streams [Paride Legovini]
    - Replace references to old team manager with new team manager
      [James Falcon]
    - tox: pin flake8 to version and add a tip-flake8 environment
      [Paride Legovini]
    - Fix flake8 E741 warning [Lucas Moura]
    - Makefile: make adjustments to call lint/style tools via python module
    - block-discover: ignore invalid id_serial/id_wwn values
    - Fix handing of reusing msdos partitions and flags
    - block.detect_multipath: ignore fake "devices" from /proc/mounts
      [Michael Hudson-Doyle]
    - udev: use shlex.quote when shlex.split errors on shell-escape chars
    - lvm: don't use vgscan --mknodes
    - vmtest: rsync don't cross filesystem boundaries when copying
    - vmtest: basic/basic_scsi adjust collect/tests for unstable device names
    - Add unittests for partition_handler calc_[dm]_part_info and kpartx paths
    - multipath: attempt to enforce /dev/mapper/mpath files are symlinks
    - block-meta: device mapper partitions may be block devices not links
    - Default to dm_name being id if empty earlier in dm_crypt_handler()
      [Łukasz 'sil2100' Zemczak]
    - storage: correct declared schema draft version for storage schema
    - test_clear_holders: add missing zfs mock
    - Mock out zfs_supported to prevent attempting to load kernel modules
    - block-meta: skip wipe device paths if not present
    - unittest: do not allow util.subp by default
    - curthooks: support multiple ESP on UEFI bootable systems
    - block-discover: handle missing multipath 'path' data, use DM_NAME
    - lvm-over-multipath: handle lookups of multipath members
    - block-meta: don't filter preserve=true devices, select by wipe
    - vmtest: basic use dname to lookup disk with multiple partitions
    - block-meta: Don't check the ptable type of a disk with no ptable
    - curthooks: always use ChrootableTarget.subp when calling efibootmgr
    - storage: enable and use multipath during storage configuration
    - block-discover: detect nvme multipath devices
    - clear-holders: Tolerate vgchange errors during discovery
    - block-meta: handle preserve with vtoc ptable
    - vmtest: use -partition file for TestReuseRAIDMemberPartition class
    - format: extra_options should be a list type
    - tox: add pyflakes to the default tox run [Paride Legovini]
    - storage_config: Add 'extra_options' parameter to allow custom mkfs
    - Add support for installing Ubuntu Core 20 images
    - tox.ini: Fix issues with new...

Read more...

Changed in curtin (Ubuntu Focal):
status: Fix Committed → Fix Released
Revision history for this message
Łukasz Zemczak (sil2100) wrote : Update Released

The verification of the Stable Release Update for curtin has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Revision history for this message
Launchpad Janitor (janitor) wrote :
Download full text (3.7 KiB)

This bug was fixed in the package curtin - 20.1-2-g42a9667f-0ubuntu1~18.04.1

---------------
curtin (20.1-2-g42a9667f-0ubuntu1~18.04.1) bionic; urgency=medium

  * New upstream snapshot. (LP: #1881003)
    - vmtests: update skiptests
    - vmtest: allow installed centos images to reboot
    - Release 20.1
    - Handle multiple separators which were found in TestAllindata vmtest
    - verify_ptable_flag: dos primary partitions use ptable_uuid map for flag
    - net_meta: add disabled mode to skip writing any network config
      [Lucas Moura]
    - vmtest: trigger guest panic to fail fast
    - Replace grub-shell-helper with install_grub command
    - vmtest-sync-images: update the URL of the maas streams [Paride Legovini]
    - Replace references to old team manager with new team manager
      [James Falcon]
    - tox: pin flake8 to version and add a tip-flake8 environment
      [Paride Legovini]
    - Fix flake8 E741 warning [Lucas Moura]
    - Makefile: make adjustments to call lint/style tools via python module
    - block-discover: ignore invalid id_serial/id_wwn values
    - Fix handing of reusing msdos partitions and flags
    - block.detect_multipath: ignore fake "devices" from /proc/mounts
      [Michael Hudson-Doyle]
    - udev: use shlex.quote when shlex.split errors on shell-escape chars
    - lvm: don't use vgscan --mknodes
    - vmtest: rsync don't cross filesystem boundaries when copying
    - vmtest: basic/basic_scsi adjust collect/tests for unstable device names
    - Add unittests for partition_handler calc_[dm]_part_info and kpartx paths
    - multipath: attempt to enforce /dev/mapper/mpath files are symlinks
    - block-meta: device mapper partitions may be block devices not links
    - Default to dm_name being id if empty earlier in dm_crypt_handler()
      [Łukasz 'sil2100' Zemczak]
    - storage: correct declared schema draft version for storage schema
    - test_clear_holders: add missing zfs mock
    - Mock out zfs_supported to prevent attempting to load kernel modules
    - block-meta: skip wipe device paths if not present
    - unittest: do not allow util.subp by default
    - curthooks: support multiple ESP on UEFI bootable systems
    - block-discover: handle missing multipath 'path' data, use DM_NAME
    - lvm-over-multipath: handle lookups of multipath members
    - block-meta: don't filter preserve=true devices, select by wipe
    - vmtest: basic use dname to lookup disk with multiple partitions
    - block-meta: Don't check the ptable type of a disk with no ptable
    - curthooks: always use ChrootableTarget.subp when calling efibootmgr
    - storage: enable and use multipath during storage configuration
    - block-discover: detect nvme multipath devices
    - clear-holders: Tolerate vgchange errors during discovery
    - block-meta: handle preserve with vtoc ptable
    - vmtest: use -partition file for TestReuseRAIDMemberPartition class
    - format: extra_options should be a list type
    - tox: add pyflakes to the default tox run [Paride Legovini]
    - storage_config: Add 'extra_options' parameter to allow custom mkfs
    - Add support for installing Ubuntu Core 20 images
    - tox.ini: Fix issues with ne...

Read more...

Changed in curtin (Ubuntu Bionic):
status: Fix Committed → Fix Released
Revision history for this message
Launchpad Janitor (janitor) wrote :
Download full text (3.7 KiB)

This bug was fixed in the package curtin - 20.1-2-g42a9667f-0ubuntu1~16.04.1

---------------
curtin (20.1-2-g42a9667f-0ubuntu1~16.04.1) xenial; urgency=medium

  * New upstream snapshot. (LP: #1881003)
    - vmtests: update skiptests
    - vmtest: allow installed centos images to reboot
    - Release 20.1
    - Handle multiple separators which were found in TestAllindata vmtest
    - verify_ptable_flag: dos primary partitions use ptable_uuid map for flag
    - net_meta: add disabled mode to skip writing any network config
      [Lucas Moura]
    - vmtest: trigger guest panic to fail fast
    - Replace grub-shell-helper with install_grub command
    - vmtest-sync-images: update the URL of the maas streams [Paride Legovini]
    - Replace references to old team manager with new team manager
      [James Falcon]
    - tox: pin flake8 to version and add a tip-flake8 environment
      [Paride Legovini]
    - Fix flake8 E741 warning [Lucas Moura]
    - Makefile: make adjustments to call lint/style tools via python module
    - block-discover: ignore invalid id_serial/id_wwn values
    - Fix handing of reusing msdos partitions and flags
    - block.detect_multipath: ignore fake "devices" from /proc/mounts
      [Michael Hudson-Doyle]
    - udev: use shlex.quote when shlex.split errors on shell-escape chars
    - lvm: don't use vgscan --mknodes
    - vmtest: rsync don't cross filesystem boundaries when copying
    - vmtest: basic/basic_scsi adjust collect/tests for unstable device names
    - Add unittests for partition_handler calc_[dm]_part_info and kpartx paths
    - multipath: attempt to enforce /dev/mapper/mpath files are symlinks
    - block-meta: device mapper partitions may be block devices not links
    - Default to dm_name being id if empty earlier in dm_crypt_handler()
      [Łukasz 'sil2100' Zemczak]
    - storage: correct declared schema draft version for storage schema
    - test_clear_holders: add missing zfs mock
    - Mock out zfs_supported to prevent attempting to load kernel modules
    - block-meta: skip wipe device paths if not present
    - unittest: do not allow util.subp by default
    - curthooks: support multiple ESP on UEFI bootable systems
    - block-discover: handle missing multipath 'path' data, use DM_NAME
    - lvm-over-multipath: handle lookups of multipath members
    - block-meta: don't filter preserve=true devices, select by wipe
    - vmtest: basic use dname to lookup disk with multiple partitions
    - block-meta: Don't check the ptable type of a disk with no ptable
    - curthooks: always use ChrootableTarget.subp when calling efibootmgr
    - storage: enable and use multipath during storage configuration
    - block-discover: detect nvme multipath devices
    - clear-holders: Tolerate vgchange errors during discovery
    - block-meta: handle preserve with vtoc ptable
    - vmtest: use -partition file for TestReuseRAIDMemberPartition class
    - format: extra_options should be a list type
    - tox: add pyflakes to the default tox run [Paride Legovini]
    - storage_config: Add 'extra_options' parameter to allow custom mkfs
    - Add support for installing Ubuntu Core 20 images
    - tox.ini: Fix issues with ne...

Read more...

Changed in curtin (Ubuntu Xenial):
status: Fix Committed → Fix Released
Dan Watkins (oddbloke)
Changed in curtin (Ubuntu):
status: In Progress → Fix Released
To post a comment you must log in.