== Begin SRU Template ==
[Impact]
This release sports both bug-fixes and new features and we would like to
make sure all of our supported customers have access to these
improvements. The notable ones are:
- Add shellcheck to CI
- util: Remove function abs_join()
- Add support for cloud-init "degraded" state
- status.json: Don't override detail key with error condition
- tools/render-template: Make yaml loading opt-in, fix setup.py
- boothook: allow stdout/stderr to emit to cloud-init-output.log
- cloud-init-generator: Various performance optimizations
- systemd: Standardize cloud-init systemd enablement
- benchmark: benchmark cloud-init-generator independent of ds-identify
- Automatically linkcheck in CI
- cmd: Don't write json status files for non-boot stages
- apport: collect ubuntu-pro logs if ubuntu-advantage.log present
- sources: do not override datasource detection if None is in list
- clean: add a new option to clean generated config files
- pep-594: drop deprecated pipes module import
Distributions:
- Debian: Set Debian's default locale to be c.UTF-8 (LP: #2038945)
- Gentoo: upstream gentoo patch
- OpenBSD: Update build-on-openbsd dependencies
- SUSE: Add suse
AliYun: Allow aliyun ds to fetch data in init-local
Azure:
- report failure to eject as error instead of debug
- Check for stale pps data from IMDS
- imds: remove limit for connection errors if route present
- workaround to disable reporting IMDS failures on Azure Stack
- errors: include http code in reason for IMDS failure
- report failure to host if ephemeral DHCP secondary NIC
- imds: ensure new errors are logged immediately when retrying
- check for primary interface when performing DHCP
- imds: retry on 429 errors for reprovisiondata
- add option to enable/disable secondary ip config
- Ignore system volume information folder while scanning
for files in the ntfs resource disk
MAAS: Add datasource to init-local timeframe
NWCS: Update DataSourceNWCS.py
VMware: Fall back to vmtoolsd if vmware-rpctool errs
ConfigModules:
- cc_apt_configure:
- add deb822 support for default sources file
- install software-properties-common when absent but needed
- Install gnupg if gpg not found
- kill dirmngr/gpg-agent without gpgconf dependency
- cc_apt_pipelining: Update docs, deprecate options
- cc_resizefs: Add bcachefs resize support
- cc_package_update_upgrade_install:
- Allow installing snaps via package_update_upgrade_install module
- cc_ubuntu_advantage:
- do not rely on uaclient.messages module
- shift CLI command from ua to pro for all interactions
- cc_set_hostname, cc_update_hostname: check for create_hostname_file
key before writing /etc/hostname
Network:
- ephemeral: Handle link up failure for both ipv4 and ipv6
- warn invalid cfg add /run/cloud-init/network-config
- remove the word "on instance boot" from cloud-init generated config
Schema:
- non-root fallback to default paths on perm errors
- annotation path for invalid top-level keys
- top-level additionalProperties: false
- network-config optional network key. route uses oneOf
- add cloud_init_deepest_matches for best error message
- add network-config support to schema subcommand
- cloud-init schema in early boot or in dev environ
- annotation of nested dicts lists in schema marks
DsIdentify:
- exit 2 on disabled state from marker or cmdline
- Allow disable service and override environment
- match Azure datasource's ds_detect() behavior
- Use grep for faster parsing of cloud config in ds-identify (LP: #2030729)
Logging:
- Standardize logging output to stderr
- Don't configure NullHandler
- Standardize use of cloudinit's logging module
- Log PPID for better debuggin
- Remove logging of PPID path
- style: Make cloudinit.log functions use snake case
- Export warning logs to status.json
Docs:
- man: Document cloud-init error codes
- Add summit digest/trip report to docs
- Clarify boothook docs
- Describe disabling cloud-init using an environment variable
- Tidy up contributing docs
- Add cloud-init overview/introduction
- vmware: Update contents relevant to disable_vmware_customization
- summit-notes: add 2023 notes for reference in mailinglist/discourse
See the changelog entry below for a full list of changes and bugs.
[Test Case]
The following development and SRU process was followed:
https://wiki.ubuntu.com/CloudinitUpdates
The cloud-init team will be in charge of attaching the artifacts and
console output of the appropriate run to the bug. cloud-init team
members will not mark ‘verification-done’ until this has happened.
* Automated Test Results
<TODO-SRU-VERIFICATION: attach automated cloud-init-proposed test artifacts from tests for each release with lxd artifacts>
<TODO-SRU-VERIFICATION: attach automated cloud-init-proposed test artifacts from tests for each release with kvm artifacts>
<TODO-SRU-VERIFICATION: attach automated curtin vmtest with cloud-init proposed>
<TODO-SRU-VERIFICATION: attach Solutions Testing team test results for each LTS>
* Manual Test Results
<TODO-SRU-VERIFICATION: attach manual cloud-init-proposed test artifacts from tests for each release on ec2 datasource>
<TODO-SRU-VERIFICATION: attach manual cloud-init-proposed test artifacts from tests for each release on gce datasource>
<TODO-SRU-VERIFICATION: attach manual cloud-init-proposed test artifacts from tests for each release on azure datasource>
[Regression Potential]
In order to mitigate the regression potential, the results of the
aforementioned integration tests are attached to this bug.
== End SRU Template ==
- tests: datasourcenone use client.restart to block until done (#4635)
- tests: increase number of retries across reboot to 90 (#4651)
- fix: Add schema for merge types (#4648)
- feat: Allow aliyun ds to fetch data in init-local (#4590) [qidong.ld]
- azure: report failure to eject as error instead of debug (#4643)
[Chris Patterson]
- bug(schema): write network-config if instance dir present (#4635)
- test: fix schema fuzzing test (#4639)
- Update build-on-openbsd dependencies (#4644) [CodeBleu]
- fix(test): Fix expected log for ipv6-only ephemeral network (#4641)
- refactor: Remove metaclass from network_state.py (#4638)
- schema: non-root fallback to default paths on perm errors (# 4631)
- fix: Don't loosen the permissions of the log file (#4628)
- Revert "logging: keep current file mode of log file if its stricter
than the new mode (#4250)"
- ephemeral: Handle link up failure for both ipv4 and ipv6 (#4547)
- fix(main): Don't call logging too early (#4595)
- fix: Remove Ubuntu-specific kernel naming convention assertion (#4617)
- fix(log): Do not implement handleError with a self parameter (#4617)
- fix(log): Don't try to reuse stderr logger (#4617)
- feat: Standardize logging output to stderr (#4617)
- chore: Sever unmaintained TODO.rst (#4625)
- test: Skip failing tests
- distros: Add suse
- test: Add default hello package version (#4614)
- fix(net): Improve DHCPv4 SUSE code, add test
- net: Fix DHCPv4 not enabled on SUSE in some cases [bin456789]
- fix(schema): Warn if missing dependency (#4616)
- fix(cli): main source cloud_config for schema validation (#4562)
- feat(schema): annotation path for invalid top-level keys (#4562)
- feat(schema): top-level additionalProperties: false (#4562)
- test: ensure top-level properties tests will pass (#4562)
- fix(schema): Add missing schema definitions (#4562)
- test: Fix snap tests (#4562)
- azure: Check for stale pps data from IMDS (#4596) [Ksenija Stanojevic]
- test: Undo dhcp6 integration test changes (#4612)
- azure: update diagnostic from warning level to debug [Chris Patterson]
- azure/imds: remove limit for connection errors if route present (#4604)
[Chris Patterson]
- [enhancement]: Add shellcheck to CI (#4488) [Aviral Singh]
- chore: add conventional commits template (#4593)
- Revert "net: allow dhcp6 configuration from
generate_fallback_configuration()" (#4607)
- azure: workaround to disable reporting IMDS failures on Azure Stack
[Chris Patterson]
- cc_apt_pipelining: Update docs, deprecate options (#4571)
- test: add gh workflows on push to main, update status badges (#4597)
- util: Remove function abs_join() (#4587)
- url_helper: Remove unused function retry_on_url_exc() (#4587)
- cc_resizefs: Add bcachefs resize support (#4594)
- integration_tests: Support non-Ubuntu distros (#4586)
- fix(cmdline): fix cmdline parsing with MAC containing cc:
- azure/errors: include http code in reason for IMDS failure
[Chris Patterson]
- tests: cloud-init schema --system does not return exit code 2
- github: allow pull request to specify desired rebase and merge
- tests: fix integration test expectations of exit 2 on schema warning
- tests: fix schema test expected cli output Valid schema <type>
- fix(schema cli): check raw userdata when processed cloud-config empty
- azure: report failure to host if ephemeral DHCP secondary NIC (#4558)
[Chris Patterson]
- man: Document cloud-init error codes (#4500)
- Add support for cloud-init "degraded" state (#4500)
- status.json: Don't override detail key with error condition (#4500)
- status: Remove duplicated data (#4500)
- refactor: Rename exported_errors in status.json (#4500)
- test: Remove stale status.json value (#4500)
- tools/render-template: Make yaml loading opt-in, fix setup.py (#4564)
- Add summit digest/trip report to docs (#4561) [Sally]
- doc: Fix incorrect statement about `cloud-init analyze`
- azure/imds: ensure new errors are logged immediately when retrying
(#4468) [Chris Patterson]
- Clarify boothook docs (#4543)
- boothook: allow stdout/stderr to emit to cloud-init-output.log
- summit-notes: add 2023 notes for reference in mailinglist/discourse
- fix: added mock to stop leaking journalctl that slows down unit test
(#4556) [Alec Warren]
- tests: maas test for DataSourceMAASLocal get_data
- maas tests: avoid using CiTest case and prefer pytest.tmpdir fixture
- MAAS: Add datasource to init-local timeframe
- Ensure all tests passed and/or are skipped
- Support QEMU in integration tests
- fix(read-dependencies): handle version specifiers containing [~!]
- test: unpin pytest
- schema: network-config optional network key. route uses oneOf (#4482)
- schema: add cloud_init_deepest_matches for best error message (#4482)
- network: warn invalid cfg add /run/cloud-init/network-config (#4482)
- schema: add network-config support to schema subcommand (#4482)
- Update version number and merge ChangeLog from 23.3.3 into main (#4553)
- azure: check for primary interface when performing DHCP (#4465)
[Chris Patterson]
- Fix hypothesis failure
- subp: add a log when skipping a file for execution for lack of exe
permission (#4506) [Ani Sinha]
- azure/imds: refactor max_connection_errors definition (#4467)
[Chris Patterson]
- chore: fix PR template rendering (#4526)
- fix(cc_apt_configure): avoid unneeded call to apt-install (#4519)
- comment difference between sysconfig and NetworkManager renderer (#4517)
[Ani Sinha]
- Set Debian's default locale to be c.UTF-8 (#4503) (LP: #2038945)
- Convert test_debian.py to pytest (#4503)
- doc: fix cloudstack link
- doc: fix development/contributing.html references
- doc: hide duplicated links
- Revert "ds-identify/CloudStack: $DS_MAYBE if vm running on vmware/xen
(#4281)" (#4511) (LP: #2039453)
- Fix the missing mcopy argument [Vladimir Pouzanov]
- tests: Add logging fix (#4499)
- Update upgrade test to account for dhcp6
- Remove logging of PPID path (#4502)
- Make Python 3.12 CI test non-experimental (#4498)
- ds-identify: exit 2 on disabled state from marker or cmdline (#4399)
- cloud-init-generator: Various performance optimizations (#4399)
- systemd: Standardize cloud-init systemd enablement (#4399)
- benchmark: benchmark cloud-init-generator independent of ds-identify
(#4399)
- tests/integration_tests: add cloud-init disablement coverage (#4399)
- doc: Describe disabling cloud-init using an environment variable (#4399)
- fix: cloud-init status --wait broken with KERNEL_CMDLINE (#4399)
- azure/imds: retry on 429 errors for reprovisiondata (#4470)
[Chris Patterson]
- cmd: Don't write json status files for non-boot stages (#4478)
- ds-identify: Allow disable service and override environment (#4485)
[Mina Galić]
- Update DataSourceNWCS.py (#4496) [shell-skrimp]
- Add r00ta to CLA signers file
- Fix override of systemd_locale_conf in rhel [Jacopo Rota]
- ci(linkcheck): minor fixes (#4495)
- integration test fix for deb822 URI format (#4492)
- test: use a mantic-compatible tz in t/i/m/test_combined.py (#4494)
- ua: shift CLI command from ua to pro for all interactions
- pro: avoid double-dash when enabling inviddual services on CLI
- net: allow dhcp6 configuration from generate_fallback_configuration()
(#4474) [Ani Sinha]
- tests: apt re.search to match alternative ordering of installed pkgs
- apt: doc apt_pkg performance improvement over subp apt-config dump
- Tidy up contributing docs (#4469) [Sally]
- [enhancement]: Automatically linkcheck in CI (#4479) [Aviral Singh]
- Revert allowing pro service warnings (#4483)
- Export warning logs to status.json (#4455)
- Fix regression in package installation (#4466)
- schema: cloud-init schema in early boot or in dev environ (#4448)
- schema: annotation of nested dicts lists in schema marks (#4448)
- feat(apport): collect ubuntu-pro logs if ubuntu-advantage.log present
(#4443)
- apt_configure: add deb822 support for default sources file (#4437)
- net: remove the word "on instance boot" from cloud-init generated config
(#4457) [Ani Sinha]
- style: Make cloudinit.log functions use snake case (#4449)
- Don't recommend using cloud-init as a library (#4459)
- vmware: Fall back to vmtoolsd if vmware-rpctool errs (#4444)
[Andrew Kutz]
- azure: add option to enable/disable secondary ip config (#4432)
[Ksenija Stanojevic]
- Allow installing snaps via package_update_upgrade_install module (#4202)
- docs: Add cloud-init overview/introduction (#4440) [Sally]
- apt: install software-properties-common when absent but needed (#4441)
- sources/Azure: Ignore system volume information folder while scanning
for files in the ntfs resource disk (#4446) [Anh Vo]
- refactor: Remove unnecessary __main__.py file
- style: Drop vi format comments
- cloudinit.log: Use more appropriate exception (#4435)
- cloudinit.log: Don't configure NullHandler (#4435)
- commit 6bbbfbbb030831c72b5aa2bba9cb8492f19d56f4
- cloudinit.log: Remove unnecessary module function and variables (#4435)
- cloudinit.log: Remove unused getLogger wrapper (#4435)
- cloudinit.log: Standardize use of cloudinit's logging module (#4435)
- Remove unnecessary logging wrapper in Cloud class (#4435)
- integration test: allow pro service warnings (#4447)
- integration tests: fix mount indentation (#4445)
- sources/Azure: fix for conflicting reports to platform (#4434)
[Chris Patterson]
- docs: link the cloud-config validation service (#4442)
- Fix pip-managed ansible on pip < 23.0.1 (#4403)
- Install gnupg if gpg not found (#4431)
- Add "phsm" as contributor (#4429) [Phsm Qwerty]
- cc_ubuntu_advantage: do not rely on uaclient.messages module (#4397)
[Grant Orndorff]
- tools/ds-identify: match Azure datasource's ds_detect() behavior (#4430)
[Chris Patterson]
- Refactor test_apt_source_v1.py to use pytest (#4427)
- sources: do not override datasource detection if None is in list (#4426)
[Chris Patterson]
- feat: check for create_hostname_file key before writing /etc/hostname
(SC-1588) (#4330) [Cat Red]
- Pytestify apt config test modules (#4424)
- upstream gentoo patch (#4422)
- Work around no instance ip (#4419)
- Fix typing issues in subp module (#4401)
- net: fix ipv6_dhcpv6_stateful/stateless/slaac configuration for rhel
(#4395) [Ani Sinha]
- Release 23.3.1
- apt: kill dirmngr/gpg-agent without gpgconf dependency (LP: #2034273)
- integration tests: fix mount indentation (#4405)
- Use grep for faster parsing of cloud config in ds-identify (#4327)
[Scott Moser] (LP: #2030729)
- doc: fix instructions on how to disable cloud-init from kernel command
line (#4406) [Ani Sinha]
- doc/vmware: Update contents relevant to disable_vmware_customization
[PengpengSun]
- Bring back flake8 for python 3.6 (#4394)
- integration tests: Fix cgroup parsing (#4402)
- summary: Update template parameter descriptions in docs [MJ Moshiri]
- Log PPID for better debugging (#4398)
- integration tests: don't clean when KEEP_* flags true (#4400)
- clean: add a new option to clean generated config files [Ani Sinha]
- pep-594: drop deprecated pipes module import
Hello Alberto, or anyone else affected,
Accepted cloud-init into mantic-proposed. The package will build now and be available at https:/
Please help us by testing this new package. See https:/
If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-
Further information regarding the verification process can be found at https:/
N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.