I'm not seeing anything stacking up in the network message queue, but I did find this in the nova-network.log:
2012-04-04 19:58:55 DEBUG nova.utils [-] Attempting to grab semaphore "iptables" for method "apply"... from (pid=5853) inner /usr/lib/python2.7/dist-packages/nova/utils.py:891 2012-04-04 19:58:55 DEBUG nova.network.linux_net [-] IPTablesManager.apply completed with success from (pid=5853) apply /usr/lib/python2.7/dist-packages/nova/network/linux_net.py:340 2012-04-04 19:58:55 ERROR nova.rpc.amqp [-] Exception during message handling (nova.rpc.amqp): TRACE: Traceback (most recent call last): (nova.rpc.amqp): TRACE: File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 252, in _process_data (nova.rpc.amqp): TRACE: rval = node_func(context=ctxt, **node_args) (nova.rpc.amqp): TRACE: File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 263, in wrapped (nova.rpc.amqp): TRACE: return func(self, context, *args, **kwargs) (nova.rpc.amqp): TRACE: File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 469, in associate_floating_ip (nova.rpc.amqp): TRACE: fixed_address, interface) (nova.rpc.amqp): TRACE: File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 490, in _associate_floating_ip (nova.rpc.amqp): TRACE: interface) (nova.rpc.amqp): TRACE: File "/usr/lib/python2.7/dist-packages/nova/network/l3.py", line 99, in add_floating_ip (nova.rpc.amqp): TRACE: linux_net.ensure_floating_forward(floating_ip, fixed_ip) (nova.rpc.amqp): TRACE: File "/usr/lib/python2.7/dist-packages/nova/network/linux_net.py", line 507, in ensure_floating_forward (nova.rpc.amqp): TRACE: iptables_manager.apply() (nova.rpc.amqp): TRACE: File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 907, in inner (nova.rpc.amqp): TRACE: retval = f(*args, **kwargs) (nova.rpc.amqp): TRACE: File "/usr/lib/python2.7/dist-packages/lockfile.py", line 230, in __exit__ (nova.rpc.amqp): TRACE: self.release() (nova.rpc.amqp): TRACE: File "/usr/lib/python2.7/dist-packages/lockfile.py", line 273, in release (nova.rpc.amqp): TRACE: raise NotMyLock (nova.rpc.amqp): TRACE: NotMyLock (nova.rpc.amqp): TRACE: 2012-04-04 19:58:55 ERROR nova.rpc.amqp [-] Returning exception to caller
I'll check the log to see if anything needs redacting and tar it up for you.
I'm not seeing anything stacking up in the network message queue, but I did find this in the nova-network.log:
2012-04-04 19:58:55 DEBUG nova.utils [-] Attempting to grab semaphore "iptables" for method "apply"... from (pid=5853) inner /usr/lib/ python2. 7/dist- packages/ nova/utils. py:891 linux_net [-] IPTablesManager .apply completed with success from (pid=5853) apply /usr/lib/ python2. 7/dist- packages/ nova/network/ linux_net. py:340 python2. 7/dist- packages/ nova/rpc/ amqp.py" , line 252, in _process_data context= ctxt, **node_args) python2. 7/dist- packages/ nova/network/ manager. py", line 263, in wrapped python2. 7/dist- packages/ nova/network/ manager. py", line 469, in associate_ floating_ ip python2. 7/dist- packages/ nova/network/ manager. py", line 490, in _associate_ floating_ ip python2. 7/dist- packages/ nova/network/ l3.py", line 99, in add_floating_ip ensure_ floating_ forward( floating_ ip, fixed_ip) python2. 7/dist- packages/ nova/network/ linux_net. py", line 507, in ensure_ floating_ forward manager. apply() python2. 7/dist- packages/ nova/utils. py", line 907, in inner python2. 7/dist- packages/ lockfile. py", line 230, in __exit__ python2. 7/dist- packages/ lockfile. py", line 273, in release
2012-04-04 19:58:55 DEBUG nova.network.
2012-04-04 19:58:55 ERROR nova.rpc.amqp [-] Exception during message handling
(nova.rpc.amqp): TRACE: Traceback (most recent call last):
(nova.rpc.amqp): TRACE: File "/usr/lib/
(nova.rpc.amqp): TRACE: rval = node_func(
(nova.rpc.amqp): TRACE: File "/usr/lib/
(nova.rpc.amqp): TRACE: return func(self, context, *args, **kwargs)
(nova.rpc.amqp): TRACE: File "/usr/lib/
(nova.rpc.amqp): TRACE: fixed_address, interface)
(nova.rpc.amqp): TRACE: File "/usr/lib/
(nova.rpc.amqp): TRACE: interface)
(nova.rpc.amqp): TRACE: File "/usr/lib/
(nova.rpc.amqp): TRACE: linux_net.
(nova.rpc.amqp): TRACE: File "/usr/lib/
(nova.rpc.amqp): TRACE: iptables_
(nova.rpc.amqp): TRACE: File "/usr/lib/
(nova.rpc.amqp): TRACE: retval = f(*args, **kwargs)
(nova.rpc.amqp): TRACE: File "/usr/lib/
(nova.rpc.amqp): TRACE: self.release()
(nova.rpc.amqp): TRACE: File "/usr/lib/
(nova.rpc.amqp): TRACE: raise NotMyLock
(nova.rpc.amqp): TRACE: NotMyLock
(nova.rpc.amqp): TRACE:
2012-04-04 19:58:55 ERROR nova.rpc.amqp [-] Returning exception to caller
I'll check the log to see if anything needs redacting and tar it up for you.