sru curtin 2018-03-28 - 18.1-0ubuntu1

Bug #1759664 reported by Scott Moser
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
curtin (Ubuntu)
Fix Released
Medium
Unassigned
Xenial
Fix Released
Medium
Unassigned
Artful
Fix Released
Medium
Unassigned

Bug Description

== Begin SRU Template ==
[Impact]
This release sports both bug-fixes and new features and we would like to
make sure all of our supported customers have access to these improvements.
The notable ones are:

 * zfs/zpool version=28 by default, allow users to override default values.
   (LP: #1754013)
 * clear_holders: wipe complex devices before disassembly (LP: #1750519)
 * Add support for installing sources that are a filesystem image.
   (LP: #1746348)
 * clear-holders: detect and remove devices from kernel swap as needed.
   (LP: #1743643)
 * Add zpool, zfs storage commands for experimental support of ZFS on root.

See the changelog entry below for a full list of changes and bugs.

[Test Case]
The following development and SRU process was followed:
https://wiki.ubuntu.com/CurtinUpdates

Curtin now contains an extensive integration test suite that is ran using
the SRU package for each releases. These suite has documentation here:
https://curtin.readthedocs.io/en/latest/topics/integration-testing.html

In order to avoid regression to existing MAAS product, the MAAS team will
run their continuous integration test against the curtin that is in
-proposed. A successful run will be required before the proposed curtin
can be let into -updates.

The curtin team will be in charge of attaching the artifacts and console
output of the appropriate run to the bug. Curtin team members will not
mark ‘verification-done’ until this has happened.

[Regression Potential]
In order to mitigate the regression potential, the results of the
aforementioned integration tests are attached to this bug.

curtin-proposed test artifacts:
 * see attached: curtin-vmtest-proposed-x-artifacts.tar.xz
 * see attached: curtin-vmtest-proposed-a-artifacts.tar.xz

maas-proposed test artifacts (LTS only):
 * xenial: See Andres comment 7 below.

[Discussion]

== End SRU Template ==

Full Changelog of upstream is below.

 - Release 18.1
 - zfs/zpool version=28 by default, allow users to override default values.
   (LP: #1754013)
 - helpers/shell-archive: drop use of tar --sparse flag (LP: #1757565)
 - vmtest: In Basic install, add entry for swap to fstab and verify its use.
 - vmtest: skip some bcache tests pending kernel fixes
 - vmtests: extend skip_by_date for lvmroot_xfsroot and network_mtu
 - vmtest: fix pollinate re.search to use groupdict()
 - Add pollinate user-agent configuration support.
 - vmtest: Remove xenial and trusty specific workaround for rooturl.
 - vmtest: Add Filesystem Battery test.
 - Remove grub2/xenial specific workarounds for zfsroot.
 - Disable dirty_disks mode for mdadm + iscsi tests
 - tools/curtainer: Try harder to get source at binary version.
 - clear_holders: wipe complex devices before disassembly (LP: #1750519)
 - vmtests: network_mtu: fix bug number and move date out one month
 - fix /usr/bin/curtin exit code in install failure (LP: #1751176)
 - docs: Document use of format command with fstype: zfsroot
 - docs: Add HACKING.rst doc to top level dir and readthedocs.
 - vmtest: fix centos root-tgz image sync
 - block_meta: Ensure offset input to sgdisk are integers.
 - Fix error in url_helper and vmtest from previous commit.
 - tools: fix curtainer to specify source version to apt-get source.
 - Add support for installing sources that are a filesystem image.
   (LP: #1746348)
 - clear-holders: detect and remove devices from kernel swap as needed.
   (LP: #1743643)
 - tests: remove xfs filesystem from basic uefi test.
 - tools: fix curtainer --source with trusty.
 - apply_net: do not write to stderr directly.
 - vmtest: Drop use of root-image.gz and maas2roottar.
 - in-target: use ChrootableTarget so that unshare pid is used.
 - tools/curtainer: check that binary and source version are the same.
   (LP: #1747077)
 - Add zfsroot as a filesystem type
 - fix modeline for shell syntax files.
 - error logs: Create error_tarfile path if path does not exist
   (LP: #1746363)
 - zfs: only load zfs on xenial+ skip artful/bionic zfs env export
 - error logs: automatically collect and tar curtin logs upon error.
 - vmtests: Support skipping skip_by_date tests based on environment.
 - Add zpool, zfs storage commands for experimental support of ZFS on root.
 - tests: revert workaround for bug in overlayroot that is now fixed.
 - tests: Bump skip_by_dates for bug 1652822 and 1671952.
 - cli: add curtin collect-logs sub-command
 - vmtest: Do not run tests of unsupported Ubuntu releases.
 - Make license headers and file footers consistent and simplify.

Scott Moser (smoser)
Changed in curtin (Ubuntu):
status: New → Fix Released
importance: Undecided → Medium
Changed in curtin (Ubuntu Xenial):
status: New → Confirmed
Changed in curtin (Ubuntu Artful):
status: New → Confirmed
Changed in curtin (Ubuntu Xenial):
importance: Undecided → Medium
Changed in curtin (Ubuntu Artful):
importance: Undecided → Medium
summary: - sru curtin 2018-03-28 - 18.1-0ubuntu1~16.04.1
+ sru curtin 2018-03-28 - 18.1-0ubuntu1
description: updated
Revision history for this message
Chris Halse Rogers (raof) wrote : Please test proposed package

Hello Scott, or anyone else affected,

Accepted curtin into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/curtin/18.1-1-g45564eef-0ubuntu1~16.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in curtin (Ubuntu Xenial):
status: Confirmed → Fix Committed
tags: added: verification-needed verification-needed-xenial
Changed in curtin (Ubuntu Artful):
status: Confirmed → Fix Committed
tags: added: verification-needed-artful
Revision history for this message
Chris Halse Rogers (raof) wrote :

Hello Scott, or anyone else affected,

Accepted curtin into artful-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/curtin/18.1-1-g45564eef-0ubuntu1~17.10.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-artful to verification-done-artful. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-artful. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Revision history for this message
Ryan Harper (raharper) wrote :
Revision history for this message
Ryan Harper (raharper) wrote :
Revision history for this message
Ryan Harper (raharper) wrote :
Revision history for this message
Ryan Harper (raharper) wrote :
description: updated
Revision history for this message
Andres Rodriguez (andreserl) wrote :
Download full text (6.4 KiB)

Curtin for Xenial from -proposed has been verified:

Full log on: http://<masa-internal-ci>/job/proposed-maas-curtin-manual/12/console

Selecting previously unselected package curtin-common.
Preparing to unpack .../curtin-common_18.1-1-g45564eef-0ubuntu1~16.04.1_all.deb ...
Unpacking curtin-common (18.1-1-g45564eef-0ubuntu1~16.04.1) ...
Selecting previously unselected package python3-curtin.
Preparing to unpack .../python3-curtin_18.1-1-g45564eef-0ubuntu1~16.04.1_all.deb ...
Unpacking python3-curtin (18.1-1-g45564eef-0ubuntu1~16.04.1) ...
Selecting previously unselected package python3-distro-info.
Preparing to unpack .../python3-distro-info_0.14build1_all.deb ...

[...]

package-test-stdout);'], kind test, sout raw, serr raw, env []
maas-integration.TestMAASIntegration.test_create_admin ... ok
maas-integration.TestMAASIntegration.test_restart_dbus_avahi ... SKIP: Avahi/DBUS are not used anymore
maas-integration.TestMAASIntegration.test_update_maas_url ... ok
maas-integration.TestMAASIntegration.test_update_maas_url_rack ... ok
maas-integration.TestMAASIntegration.test_check_initial_services_systemctl ... ok
maas-integration.TestMAASIntegration.test_check_rpc_info ... ok
maas-integration.TestMAASIntegration.test_update_preseed_arm ... SKIP: Don't test ARM nodes
maas-integration.TestMAASIntegration.test_login_api ... ok
maas-integration.TestMAASIntegration.test_maas_logged_in ... ok
maas-integration.TestMAASIntegration.test_set_main_archive ... ok
maas-integration.TestMAASIntegration.test_main_archive_in_enlist_userdata_package_mirrors_config ... SKIP: Cloud-init "package_mirror" config is used in MAAS 2.0 and earlier
maas-integration.TestMAASIntegration.test_main_archive_in_enlist_userdata_apt_config ... ok
maas-integration.TestMAASIntegration.test_set_http_proxy ... ok
maas-integration.TestMAASIntegration.test_add_ssh_key ... ok
maas-integration.TestMAASIntegration.test_region_rack_connected ... ok
maas-integration.TestMAASIntegration.test_stop_image_import ... ok
maas-integration.TestMAASIntegration.test_set_custom_boot_source ... SKIP: Not testing custom images
maas-integration.TestMAASIntegration.test_add_boot_source_selection_ppc64el ... SKIP: Not testing PPC systems
maas-integration.TestMAASIntegration.test_add_boot_source_selection_arm64 ... SKIP: Not testing arm64 systems
maas-integration.TestMAASIntegration.test_add_boot_source_selection_centos ... ok
maas-integration.TestMAASIntegration.test_start_image_import ... ok
maas-integration.TestMAASIntegration.test_create_dynamic_range ... ok
maas-integration.TestMAASIntegration.test_reserve_bmc_range ... ok
maas-integration.TestMAASIntegration.test_create_slave_device_and_link_subnet ... ok
maas-integration.TestMAASIntegration.test_slave_device_interface_linked ... ok
maas-integration.TestMAASIntegration.test_set_up_dhcp_vlan ... ok
maas-integration.TestMAASIntegration.test_check_dhcp_service_systemctl ... ok
maas-integration.TestMAASIntegration.test_update_dns_config_systemctl ... ok
maas-integration.TestMAASIntegration.test_add_new_zones ... ok
maas-integration.TestMAASIntegration.test_list_zones ... ok
maas-integration.TestMAASIntegration.test_delete_zone ... ok
maas-integration.Test...

Read more...

Revision history for this message
Andres Rodriguez (andreserl) wrote :
Download full text (5.8 KiB)

Curtin for Artful from -proposed has been verified:

Full log on: http://<masa-internal-ci>/job/proposed-maas-curtin-manual/13/console

package-test-stdout);'], kind test, sout raw, serr raw, env []
maas-integration.TestMAASIntegration.test_create_admin ... ok
maas-integration.TestMAASIntegration.test_restart_dbus_avahi ... SKIP: Avahi/DBUS are not used anymore
maas-integration.TestMAASIntegration.test_update_maas_url ... ok
maas-integration.TestMAASIntegration.test_update_maas_url_rack ... ok
maas-integration.TestMAASIntegration.test_check_initial_services_systemctl ... ok
maas-integration.TestMAASIntegration.test_check_rpc_info ... ok
maas-integration.TestMAASIntegration.test_update_preseed_arm ... SKIP: Don't test ARM nodes
maas-integration.TestMAASIntegration.test_login_api ... ok
maas-integration.TestMAASIntegration.test_maas_logged_in ... ok
maas-integration.TestMAASIntegration.test_set_main_archive ... ok
maas-integration.TestMAASIntegration.test_main_archive_in_enlist_userdata_package_mirrors_config ... SKIP: Cloud-init "package_mirror" config is used in MAAS 2.0 and earlier
maas-integration.TestMAASIntegration.test_main_archive_in_enlist_userdata_apt_config ... ok
maas-integration.TestMAASIntegration.test_set_http_proxy ... ok
maas-integration.TestMAASIntegration.test_add_ssh_key ... ok
maas-integration.TestMAASIntegration.test_region_rack_connected ... ok
maas-integration.TestMAASIntegration.test_stop_image_import ... ok
maas-integration.TestMAASIntegration.test_set_custom_boot_source ... SKIP: Not testing custom images
maas-integration.TestMAASIntegration.test_add_boot_source_selection_ppc64el ... SKIP: Not testing PPC systems
maas-integration.TestMAASIntegration.test_add_boot_source_selection_arm64 ... SKIP: Not testing arm64 systems
maas-integration.TestMAASIntegration.test_add_boot_source_selection_centos ... ok
maas-integration.TestMAASIntegration.test_start_image_import ... ok
maas-integration.TestMAASIntegration.test_create_dynamic_range ... ok
maas-integration.TestMAASIntegration.test_reserve_bmc_range ... ok
maas-integration.TestMAASIntegration.test_create_slave_device_and_link_subnet ... ok
maas-integration.TestMAASIntegration.test_slave_device_interface_linked ... ok
maas-integration.TestMAASIntegration.test_set_up_dhcp_vlan ... ok
maas-integration.TestMAASIntegration.test_check_dhcp_service_systemctl ... ok
maas-integration.TestMAASIntegration.test_update_dns_config_systemctl ... ok
maas-integration.TestMAASIntegration.test_add_new_zones ... ok
maas-integration.TestMAASIntegration.test_list_zones ... ok
maas-integration.TestMAASIntegration.test_delete_zone ... ok
maas-integration.TestMAASIntegration.test_add_new_spaces ... ok
maas-integration.TestMAASIntegration.test_create_subnet ... ok
maas-integration.TestMAASIntegration.test_list_spaces ... ok
maas-integration.TestMAASIntegration.test_list_subnets ... ok
maas-integration.TestMAASIntegration.test_delete_subnet ... ok
maas-integration.TestMAASIntegration.test_delete_space ... ok
maas-integration.TestMAASIntegration.test_add_new_fabrics ... ok
maas-integration.TestMAASIntegration.test_add_vlan_to_fabric ... ok
maas-integration.TestMAASIntegration.test_list_fabrics ... o...

Read more...

Scott Moser (smoser)
description: updated
description: updated
Ryan Harper (raharper)
tags: added: verification-done-artful verification-done-xenial
removed: verification-needed-artful verification-needed-xenial
tags: added: verification-done
removed: verification-needed
Revision history for this message
Łukasz Zemczak (sil2100) wrote : Update Released

The verification of the Stable Release Update for curtin has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package curtin - 18.1-1-g45564eef-0ubuntu1~16.04.1

---------------
curtin (18.1-1-g45564eef-0ubuntu1~16.04.1) xenial; urgency=medium

  * New upstream snapshot. (LP: #1759664)
    - Drop ubuntu branch management script new-upstream-snapshot.
    - Release 18.1
    - zfs/zpool version=28 by default, allow users to override default values.
    - helpers/shell-archive: drop use of tar --sparse flag
    - vmtest: In Basic install, add entry for swap to fstab and verify its use.
    - vmtest: skip some bcache tests pending kernel fixes
    - vmtests: extend skip_by_date for lvmroot_xfsroot and network_mtu
    - vmtest: fix pollinate re.search to use groupdict()
    - Add pollinate user-agent configuration support.
    - vmtest: Remove xenial and trusty specific workaround for rooturl.
    - vmtest: Add Filesystem Battery test.
    - Remove grub2/xenial specific workarounds for zfsroot.
    - Disable dirty_disks mode for mdadm + iscsi tests
    - tools/curtainer: Try harder to get source at binary version.
    - clear_holders: wipe complex devices before disassembly
    - vmtests: network_mtu: fix bug number and move date out one month
    - fix /usr/bin/curtin exit code in install failure
    - docs: Document use of format command with fstype: zfsroot
    - docs: Add HACKING.rst doc to top level dir and readthedocs.
    - vmtest: fix centos root-tgz image sync
    - block_meta: Ensure offset input to sgdisk are integers.
    - Fix error in url_helper and vmtest from previous commit.
    - tools: fix curtainer to specify source version to apt-get source.
    - Add support for installing sources that are a filesystem image.
    - clear-holders: detect and remove devices from kernel swap as needed.
    - tests: remove xfs filesystem from basic uefi test.
    - tools: fix curtainer --source with trusty.
    - apply_net: do not write to stderr directly.
    - vmtest: Drop use of root-image.gz and maas2roottar.
    - in-target: use ChrootableTarget so that unshare pid is used.
    - tools/curtainer: check that binary and source version are the same.
    - Add zfsroot as a filesystem type
    - fix modeline for shell syntax files.
    - error logs: Create error_tarfile path if path does not exist
    - zfs: only load zfs on xenial+ skip artful/bionic zfs env export
    - error logs: automatically collect and tar curtin logs upon error.
    - vmtests: Support skipping skip_by_date tests based on environment.
    - Add zpool, zfs storage commands for experimental support of ZFS on root.
    - tests: revert workaround for bug in overlayroot that is now fixed.
    - tests: Bump skip_by_dates for bug 1652822 and 1671952.
    - cli: add curtin collect-logs sub-command
    - vmtest: Do not run tests of unsupported Ubuntu releases.
    - Make license headers and file footers consistent and simplify.

 -- Ryan Harper <email address hidden> Thu, 29 Mar 2018 09:25:22 -0500

Changed in curtin (Ubuntu Xenial):
status: Fix Committed → Fix Released
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package curtin - 18.1-1-g45564eef-0ubuntu1~17.10.1

---------------
curtin (18.1-1-g45564eef-0ubuntu1~17.10.1) artful; urgency=medium

  * New upstream snapshot. (LP: #1759664)
    - Drop ubuntu branch management script new-upstream-snapshot.
    - Release 18.1
    - zfs/zpool version=28 by default, allow users to override default values.
    - helpers/shell-archive: drop use of tar --sparse flag
    - vmtest: In Basic install, add entry for swap to fstab and verify its use.
    - vmtest: skip some bcache tests pending kernel fixes
    - vmtests: extend skip_by_date for lvmroot_xfsroot and network_mtu
    - vmtest: fix pollinate re.search to use groupdict()
    - Add pollinate user-agent configuration support.
    - vmtest: Remove xenial and trusty specific workaround for rooturl.
    - vmtest: Add Filesystem Battery test.
    - Remove grub2/xenial specific workarounds for zfsroot.
    - Disable dirty_disks mode for mdadm + iscsi tests
    - tools/curtainer: Try harder to get source at binary version.
    - clear_holders: wipe complex devices before disassembly
    - vmtests: network_mtu: fix bug number and move date out one month
    - fix /usr/bin/curtin exit code in install failure
    - docs: Document use of format command with fstype: zfsroot
    - docs: Add HACKING.rst doc to top level dir and readthedocs.
    - vmtest: fix centos root-tgz image sync
    - block_meta: Ensure offset input to sgdisk are integers.
    - Fix error in url_helper and vmtest from previous commit.
    - tools: fix curtainer to specify source version to apt-get source.
    - Add support for installing sources that are a filesystem image.
    - clear-holders: detect and remove devices from kernel swap as needed.
    - tests: remove xfs filesystem from basic uefi test.
    - tools: fix curtainer --source with trusty.
    - apply_net: do not write to stderr directly.
    - vmtest: Drop use of root-image.gz and maas2roottar.
    - in-target: use ChrootableTarget so that unshare pid is used.
    - tools/curtainer: check that binary and source version are the same.
    - Add zfsroot as a filesystem type
    - fix modeline for shell syntax files.
    - error logs: Create error_tarfile path if path does not exist
    - zfs: only load zfs on xenial+ skip artful/bionic zfs env export
    - error logs: automatically collect and tar curtin logs upon error.
    - vmtests: Support skipping skip_by_date tests based on environment.
    - Add zpool, zfs storage commands for experimental support of ZFS on root.
    - tests: revert workaround for bug in overlayroot that is now fixed.
    - tests: Bump skip_by_dates for bug 1652822 and 1671952.
    - cli: add curtin collect-logs sub-command
    - vmtest: Do not run tests of unsupported Ubuntu releases.
    - Make license headers and file footers consistent and simplify.

 -- Ryan Harper <email address hidden> Thu, 29 Mar 2018 09:14:52 -0500

Changed in curtin (Ubuntu Artful):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.