OpenStack Compute (nova)

nova live-migration failure

Bug #1078219 reported by maying
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
New
Undecided
Unassigned

Bug Description

Hi,everyone.
I have installed Folsm version in Ubuntu12.10 with apt-get,my two compute node is:
openstack-folsm-node2
openstack-folsm-node3

An instance which id is"81186af6-ae28-490c-b995-1924c0ae5249" has created on openstack-folsm-node3,so when i do live migration with command "nova live-migration 81186af6-ae28-490c-b995-1924c0ae5249 openstack-folsm-node2",it takes error below:
ERROR: Live migration of instance 5a614a97-9042-42b5-8b06-782f55856837 to host openstack-folsm-node2 failed (HTTP 400) (Request-ID: req-a817ad9e-4b3d-43e2-b1c2-8ef82a9b6e87)

Here is my nova-api.log when doing live migration:

ERROR nova.api.openstack.compute.contrib.admin_actions [req-064a1983-b81e-4230-8e67-edc38c321620 75c76e7f7b72470ba277bb848ad94a0b 75865a1eabed4abd84ed4045f0de973c] Live migration of instance 81186af6-ae28-490c-b995-1924c0ae5249 to host openstack-folsm-node2 failed
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions Traceback (most recent call last):
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/contrib/admin_actions.py", line 282, in _migrate_live
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions disk_over_commit, host)
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 94, in inner
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions return f(self, context, instance, *args, **kw)
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 1960, in live_migrate
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions disk_over_commit, instance, host)
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/scheduler/rpcapi.py", line 96, in live_migration
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions dest=dest))
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/proxy.py", line 80, in call
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions return rpc.call(context, self._get_topic(topic), msg, timeout)
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/__init__.py", line 102, in call
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions return _get_impl().call(cfg.CONF, context, topic, msg, timeout)
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_kombu.py", line 712, in call
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions rpc_amqp.get_connection_pool(conf, Connection))
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 368, in call
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions rv = list(rv)
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 336, in __iter__
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions raise result
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions RemoteError: Remote error: RemoteError Remote error: TypeError error() takes at least 2 arguments (1 given)
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 275, in _process_data\n rval = self.proxy.dispatch(ctxt, version, method, **args)\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch\n return getattr(proxyobj, method)(ctxt, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped\n temp_level, payload)\n', u' File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n self.gen.next()\n', u' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped\n return f(*args, **kw)\n', u' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2076, in check_can_live_migrate_destination\n instance, block_migration, disk_over_commit)\n', u' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2238, in check_can_live_migrate_destination\n self._compare_cpu(source_cpu_info)\n', u' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2366, in _compare_cpu\n LOG.error(reason=m % locals())\n', u'TypeError: error() takes at least 2 arguments (1 given)\n'].
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 275, in _process_data\n rval = self.proxy.dispatch(ctxt, version, method, **args)\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch\n return getattr(proxyobj, method)(ctxt, **kwargs)\n', u' File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 95, in live_migration\n context, ex, {})\n', u' File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n self.gen.next()\n', u' File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 90, in live_migration\n block_migration, disk_over_commit)\n', u' File "/usr/lib/python2.7/dist-packages/nova/scheduler/driver.py", line 235, in schedule_live_migration\n context, instance, dest, block_migration, disk_over_commit)\n', u' File "/usr/lib/python2.7/dist-packages/nova/compute/rpcapi.py", line 195, in check_can_live_migrate_destination\n ctxt, destination, None))\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/proxy.py", line 80, in call\n return rpc.call(context, self._get_topic(topic), msg, timeout)\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/__init__.py", line 102, in call\n return _get_impl().call(cfg.CONF, context, topic, msg, timeout)\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/impl_kombu.py", line 712, in call\n rpc_amqp.get_connection_pool(conf, Connection))\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 368, in call\n rv = list(rv)\n', u' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 336, in __iter__\n raise result\n', u'RemoteError: Remote error: TypeError error() takes at least 2 arguments (1 given)\n[u\'Traceback (most recent call last):\\n\', u\' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 275, in _process_data\\n rval = self.proxy.dispatch(ctxt, version, method, **args)\\n\', u\' File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch\\n return getattr(proxyobj, method)(ctxt, **kwargs)\\n\', u\' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped\\n temp_level, payload)\\n\', u\' File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\\n self.gen.next()\\n\', u\' File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped\\n return f(*args, **kw)\\n\', u\' File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2076, in check_can_live_migrate_destination\\n instance, block_migration, disk_over_commit)\\n\', u\' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2238, in check_can_live_migrate_destination\\n self._compare_cpu(source_cpu_info)\\n\', u\' File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2366, in _compare_cpu\\n LOG.error(reason=m % locals())\\n\', u\'TypeError: error() takes at least 2 arguments (1 given)\\n\'].\n'].
2012-11-13 15:09:05 TRACE nova.api.openstack.compute.contrib.admin_actions
2012-11-13 15:09:05 INFO nova.api.openstack.wsgi [req-064a1983-b81e-4230-8e67-edc38c321620 75c76e7f7b72470ba277bb848ad94a0b 75865a1eabed4abd84ed4045f0de973c] HTTP exception thrown: Live migration of instance 81186af6-ae28-490c-b995-1924c0ae5249 to host openstack-folsm-node2 failed

I have noticed the sentence "TypeError: error() takes at least 2 arguments (1 given)",what's that mean ?
THX!

Revision history for this message
Darren Worrall (dazworrall) wrote :

There's a typo in the error raising code (there's a fix committed for that https://bugs.launchpad.net/nova/+bug/1076308), looking at the stack trace you'll probably find that the actual exception is "InvalidCPUInfo: Unacceptable CPU info: CPU doesn't have compatibility."

Revision history for this message
maying (breeze7086) wrote :

Thx for reply me !
I have looked "https://bugs.launchpad.net/nova/+bug/1076308" and fix the code in "nova/virt/libvirt/driver.py",but it raise new error,here is the key log:

raise exception.InvalidCPUInfo(reason=m % locals())\n\nInvalidCPUInfo: Unacceptable CPU info: CPU doesn\'t have compatibility.\n\n0\n\nRefer to http://libvirt.org/html/libvirt-libvirt.html#virCPUCompareResult\n\n'].

what can i do for this ? My compute node node2 and node3 can create instances by itself.

Revision history for this message
maying (breeze7086) wrote :

add my CPU flags info
node2:fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl aperfmperf pni dtes64 monitor ds_cpl vmx tm2 ssse3 cx16 xtpr pdcm dca lahf_lm dtherm tpr_shadow

node3:fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 lahf_lm dtherm tpr_shadow vnmi flexpriority

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.