cloud-images

cloud-init fails to run on latest cosmic minimal image

Bug #1796917 reported by Dan Watkins
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
cloud-images
Fix Released
High
Scott Moser
cloud-init (Ubuntu)
Fix Released
Undecided
Unassigned

Bug Description

When cloud-init runs in the latest cosmic minimal image, we see the following traceback:

cloud-init[108]: Traceback (most recent call last):
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 658, in status_wrapper
cloud-init[108]: ret = functor(name, args)
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 362, in main_init
cloud-init[108]: init.apply_network_config(bring_up=bool(mode != sources.DSMODE_LOCAL))
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/stages.py", line 648, in apply_network_config
cloud-init[108]: netcfg, src = self._find_networking_config()
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/stages.py", line 635, in _find_networking_config
cloud-init[108]: if self.datasource and hasattr(self.datasource, 'network_config'):
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceOpenStack.py", line 115, in network_config
cloud-init[108]: self.network_json, known_macs=None)
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/sources/helpers/openstack.py", line 655, in convert_net_json
cloud-init[108]: known_macs = net.get_interfaces_by_mac()
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/net/__init__.py", line 595, in get_interfaces_by_mac
cloud-init[108]: (name, ret[mac], mac))
cloud-init[108]: RuntimeError: duplicate mac found! both 'sit0' and 'tunl0' have mac '00:00:00:00'

It appears that the devices presented by the latest linux-kvm is now different; this is the table output by cloud-init in the previous minimal image:

+++++++++++++++++++++++++++++++++++++++Net device info++++++++++++++++++++++++++++++++++++++++
+--------+-------+------------------------------+---------------+--------+-------------------+
| Device | Up | Address | Mask | Scope | Hw-Address |
+--------+-------+------------------------------+---------------+--------+-------------------+
| ens2 | True | 10.220.168.37 | 255.255.255.0 | global | fa:16:3e:ef:89:9a |
| ens2 | True | fe80::f816:3eff:feef:899a/64 | . | link | fa:16:3e:ef:89:9a |
| lo | True | 127.0.0.1 | 255.0.0.0 | host | . |
| lo | True | ::1/128 | . | host | . |
| sit0 | False | . | . | . | . |
+--------+-------+------------------------------+---------------+--------+-------------------+

Whereas the new image shows:

+++++++++++++++++++++++++++Net device info++++++++++++++++++++++++++++
+--------+-------+-----------+-----------+-------+-------------------+
| Device | Up | Address | Mask | Scope | Hw-Address |
+--------+-------+-----------+-----------+-------+-------------------+
| ens2 | False | . | . | . | fa:16:3e:15:a7:3b |
| lo | True | 127.0.0.1 | 255.0.0.0 | host | . |
| lo | True | ::1/128 | . | host | . |
| sit0 | False | . | . | . | . |
| tunl0 | False | . | . | . | . |
+--------+-------+-----------+-----------+-------+-------------------+

Specifically, the tunl0 device has been added.

See original description

Related branches

~chad.smith/cloud-init:ubuntu/devel
Server Team CI bot: Approve (continuous-integration)
Scott Moser: Approve
Diff: 2628 lines (+1096/-307)
42 files modified
cloudinit/cmd/cloud_id.py (+90/-0)
cloudinit/cmd/tests/test_cloud_id.py (+127/-0)
cloudinit/net/__init__.py (+4/-2)
cloudinit/sources/DataSourceAliYun.py (+5/-15)
cloudinit/sources/DataSourceAltCloud.py (+22/-11)
cloudinit/sources/DataSourceAzure.py (+8/-0)
cloudinit/sources/DataSourceBigstep.py (+4/-0)
cloudinit/sources/DataSourceCloudSigma.py (+5/-1)
cloudinit/sources/DataSourceConfigDrive.py (+12/-0)
cloudinit/sources/DataSourceEc2.py (+59/-56)
cloudinit/sources/DataSourceIBMCloud.py (+4/-0)
cloudinit/sources/DataSourceMAAS.py (+4/-0)
cloudinit/sources/DataSourceNoCloud.py (+21/-0)
cloudinit/sources/DataSourceNone.py (+4/-0)
cloudinit/sources/DataSourceOVF.py (+6/-0)
cloudinit/sources/DataSourceOpenNebula.py (+8/-0)
cloudinit/sources/DataSourceOracle.py (+4/-0)
cloudinit/sources/DataSourceSmartOS.py (+3/-0)
cloudinit/sources/__init__.py (+104/-21)
cloudinit/sources/tests/test_init.py (+83/-3)
cloudinit/sources/tests/test_oracle.py (+8/-0)
cloudinit/tests/test_util.py (+16/-0)
cloudinit/util.py (+5/-0)
debian/changelog (+11/-0)
doc/rtd/topics/instancedata.rst (+137/-46)
setup.py (+2/-1)
templates/sources.list.ubuntu.tmpl (+17/-17)
tests/cloud_tests/testcases/base.py (+11/-2)
tests/cloud_tests/testcases/modules/apt_configure_primary.py (+9/-5)
tests/cloud_tests/testcases/modules/apt_configure_primary.yaml (+0/-7)
tests/unittests/test_datasource/test_aliyun.py (+4/-0)
tests/unittests/test_datasource/test_altcloud.py (+67/-51)
tests/unittests/test_datasource/test_azure.py (+63/-47)
tests/unittests/test_datasource/test_cloudsigma.py (+6/-0)
tests/unittests/test_datasource/test_configdrive.py (+3/-0)
tests/unittests/test_datasource/test_ec2.py (+13/-7)
tests/unittests/test_datasource/test_ibmcloud.py (+39/-1)
tests/unittests/test_datasource/test_nocloud.py (+35/-10)
tests/unittests/test_datasource/test_opennebula.py (+4/-0)
tests/unittests/test_datasource/test_ovf.py (+48/-4)
tests/unittests/test_datasource/test_smartos.py (+7/-0)
tests/unittests/test_net.py (+14/-0)
~smoser/cloud-init:fix/1796917-ignore-all-zero-macs
Server Team CI bot: Approve (continuous-integration)
Chad Smith: Approve
Ryan Harper: Approve
Diff: 52 lines (+18/-2)
2 files modified
cloudinit/net/__init__.py (+4/-2)
tests/unittests/test_net.py (+14/-0)
~rjschwei/cloud-init:systemdGenTmpl
Chad Smith: Approve
Server Team CI bot: Approve (continuous-integration)
Scott Moser: Needs Fixing
Scott Moser [2]: Pending requested
Diff: 66 lines (+15/-3)
2 files modified
setup.py (+10/-3)
systemd/cloud-init-generator.tmpl (+5/-0)
Revision history for this message
Dan Watkins (oddbloke) wrote :

It's not clear to me whether this is a cloud-init bug or a kernel bug, so I've filed it in cloud-images for triage for now.

description: updated
Changed in cloud-images:
importance: Undecided → High
Revision history for this message
Chad Smith (chad.smith) wrote :

Can we get the network configuration passed to this instance or the cloud-init.logs.tar it might shed more light on a configuration that we need to take into account in cloud-init. We can certainly attempt to ignore duplicate mac checks in cloud-init if macs are returned as 6-tuple of 00. But we probably want to make sure we are also understanding the full network config in this case too.

Revision history for this message
Chad Smith (chad.smith) wrote :

cloud-init collect-logs would harvest a tarfile of all cloud-init artifacts.

Scott Moser (smoser)
Changed in cloud-images:
status: New → In Progress
assignee: nobody → Scott Moser (smoser)
Revision history for this message
Server Team CI bot (server-team-bot) wrote :

This bug is fixed with commit 00e36d3d to cloud-init on branch master.
To view that commit see the following URL:
https://git.launchpad.net/cloud-init/commit/?id=00e36d3d

Chad Smith (chad.smith)
Changed in cloud-images:
status: In Progress → Fix Committed
Dan Watkins (oddbloke)
Changed in cloud-images:
status: Fix Committed → Fix Released
Revision history for this message
panticz.de (panticz.de) wrote :

The Ubuntu 18.04 minimal cloud image from 22-Nov-2018 20:29 (https://cloud-images.ubuntu.com/minimal/releases/bionic/release/ubuntu-18.04-minimal-cloudimg-amd64.img)
is still affected from this issue:

cloud-init[108]: Cloud-init v. 18.4-0ubuntu1~18.04.1 running 'init-local' at Mon, 03 Dec 2018 08:49:26 +0000. Up 18.64 seconds.
cloud-init[108]: 2018-12-03 08:49:27,381 - util.py[WARNING]: failed stage init-local
cloud-init[108]: failed run of stage init-local
cloud-init[108]: ------------------------------------------------------------
cloud-init[108]: Traceback (most recent call last):
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 658, in status_wrapper
cloud-init[108]: ret = functor(name, args)
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 362, in main_init
cloud-init[108]: init.apply_network_config(bring_up=bool(mode != sources.DSMODE_LOCAL))
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/stages.py", line 648, in apply_network_config
cloud-init[108]: netcfg, src = self._find_networking_config()
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/stages.py", line 635, in _find_networking_config
cloud-init[108]: if self.datasource and hasattr(self.datasource, 'network_config'):
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/sources/DataSourceConfigDrive.py", line 155, in network_config
cloud-init[108]: self.network_json, known_macs=self.known_macs)
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/sources/helpers/openstack.py", line 655, in convert_net_json
cloud-init[108]: known_macs = net.get_interfaces_by_mac()
cloud-init[108]: File "/usr/lib/python3/dist-packages/cloudinit/net/__init__.py", line 595, in get_interfaces_by_mac
cloud-init[108]: (name, ret[mac], mac))
cloud-init[108]: RuntimeError: duplicate mac found! both 'sit0' and 'tunl0' have mac '00:00:00:00'
cloud-init[108]: ------------------------------------------------------------
[[0;1;31mFAILED[0m] Failed to start Initial cloud-init job (pre-networking).

Ryan Harper (raharper)
Changed in cloud-init (Ubuntu):
status: New → Fix Released
Ryan Harper (raharper)
Changed in cloud-init (Ubuntu):
status: Fix Released → Fix Committed
Dan Watkins (oddbloke)
Changed in cloud-init (Ubuntu):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.