OpenStack Compute (nova)

Unable to spawn instance after I delete and create same network

Bug #1036672 reported by Boris Filippov
18
This bug affects 4 people
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Invalid
Medium
Unassigned

Bug Description

Steps to reproduce:

1. Create project and network
2. Spawn instance
3. Delete instance
4. Delete project and network
5. Create same network
6. Create project
7. Spawn instance

Affected releases: OpenStack Essex

Description:

You are unable to spawn instance with network that was previosly deleted and recreated. Instance get ERROR state and in nova-compute.log you will see this error:

2012-08-13 19:47:38 nova.compute.manager: ERROR [req-51fc575d-6e0f-482e-8087-7fcacfd72af4 0d2d8dab9f9d415986d28505ed4861bb b833a8f1094b4815b50ddcc21b2b6423] Instance failed to spawn
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] Traceback (most recent call last):
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 598, in _spawn
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] self._legacy_nw_info(network_info), block_device_info)
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] File "/usr/lib/python2.6/site-packages/nova/exception.py", line 114, in wrapped
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] return f(*args, **kw)
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/connection.py", line 919, in spawn
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] block_device_info=block_device_info)
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/connection.py", line 1539, in to_xml
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] rescue, block_device_info)
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/connection.py", line 1422, in _prepare_xml_info
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] nics.append(self.vif_driver.plug(instance, network, mapping))
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/vif.py", line 99, in plug
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] return self._get_configurations(network, mapping)
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/vif.py", line 69, in _get_configurations
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] 'ip_address': mapping['ips'][0]['ip'],
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a] IndexError: list index out of range
2012-08-13 19:47:38 TRACE nova.compute.manager [instance: f6531b3d-9764-48b8-b36f-695c8f06480a]

Revision history for this message
Alexej Ababilov (aababilov) wrote :
Download full text (3.2 KiB)

While deallocation, nova-network log looks like:

2012-08-13 17:22:32 DEBUG nova.network.manager [req-ead1ceef-fe4d-4a52-984c-0649226673b0 f3dc44870a8240a0b1af0a6de7a0e9b9 9b43eb4f9f02484e83f85efd3f6df73a] floating IP deallocation for instance |7| from (pid=260
4) deallocate_for_instance /usr/lib/python2.6/site-packages/nova/network/manager.py:353
2012-08-13 17:22:32 DEBUG nova.network.manager [req-ead1ceef-fe4d-4a52-984c-0649226673b0 f3dc44870a8240a0b1af0a6de7a0e9b9 9b43eb4f9f02484e83f85efd3f6df73a] network deallocation for instance |7| from (pid=2604) d
eallocate_for_instance /usr/lib/python2.6/site-packages/nova/network/manager.py:930
2012-08-13 17:22:32 ERROR nova.rpc.amqp [req-ead1ceef-fe4d-4a52-984c-0649226673b0 f3dc44870a8240a0b1af0a6de7a0e9b9 9b43eb4f9f02484e83f85efd3f6df73a] Exception during message handling
2012-08-13 17:22:32 TRACE nova.rpc.amqp Traceback (most recent call last):
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/rpc/amqp.py", line 253, in _process_data
2012-08-13 17:22:32 TRACE nova.rpc.amqp rval = node_func(context=ctxt, **node_args)
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 257, in wrapped
2012-08-13 17:22:32 TRACE nova.rpc.amqp return func(self, context, *args, **kwargs)
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 379, in deallocate_for_instance
2012-08-13 17:22:32 TRACE nova.rpc.amqp super(FloatingIP, self).deallocate_for_instance(context, **kwargs)
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 257, in wrapped
2012-08-13 17:22:32 TRACE nova.rpc.amqp return func(self, context, *args, **kwargs)
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 934, in deallocate_for_instance
2012-08-13 17:22:32 TRACE nova.rpc.amqp **kwargs)
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 230, in deallocate_fixed_ip
2012-08-13 17:22:32 TRACE nova.rpc.amqp network = self._get_network_by_id(context, fixed_ip['network_id'])
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/manager.py", line 1550, in _get_network_by_id
2012-08-13 17:22:32 TRACE nova.rpc.amqp return self.db.network_get(context, network_id)
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/db/api.py", line 755, in network_get
2012-08-13 17:22:32 TRACE nova.rpc.amqp return IMPL.network_get(context, network_id)
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/db/sqlalchemy/api.py", line 120, in wrapper
2012-08-13 17:22:32 TRACE nova.rpc.amqp return f(*args, **kwargs)
2012-08-13 17:22:32 TRACE nova.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/db/sqlalchemy/api.py", line 1933, in network_get
2012-08-13 17:22:32 TRACE nova.rpc.amqp raise exception.NetworkNotFound(network_id=network_id)
2012-08-13 17:22:32 TRACE nova.rpc.amqp NetworkNotFound: Network 7 ...

Read more...

Revision history for this message
Roman Sokolkov (rsokolkov) wrote :

Please see my comment (last) on this bug

https://bugs.launchpad.net/nova/+bug/1017633

Boris Filippov (bfilippov)
Changed in nova:
status: New → Confirmed
Thierry Carrez (ttx)
Changed in nova:
importance: Undecided → Medium
lizheming (lizheming-li)
Changed in nova:
assignee: nobody → lizheming (lizheming-li)
lizheming (lizheming-li)
Changed in nova:
assignee: lizheming (lizheming-li) → nobody
Revision history for this message
haruka tanizawa (h-tanizawa) wrote :

Is this still happen?

Joe Gordon (jogo)
Changed in nova:
status: Confirmed → Incomplete
Revision history for this message
Sean Dague (sdague) wrote :

really old invalid bug

Changed in nova:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.