From API logs,
https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/45d7fc9/logs/overcloud-controller-1/var/log/containers/nova/nova-api.log.txt.gz
2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi [req-1305def1-184b-4e3e-9397-a033898bdeb5 9a28aa13588843d7a85454243e67b2f7 0a253617f3f146f3bceaf87cbced627f - default default] Unexpected exception in API method: AttributeError: 'NoneType' object has no attribute 'uuid' 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi Traceback (most recent call last): 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/objects/instance.py", line 655, in destroy 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi hard_delete=hard_delete) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/db/api.py", line 549, in instance_destroy 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi hard_delete=hard_delete) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/db/sqlalchemy/api.py", line 179, in wrapper 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi return f(*args, **kwargs) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/oslo_db/api.py", line 154, in wrapper 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi ectxt.value = e.inner_exc 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi self.force_reraise() 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi six.reraise(self.type_, self.value, self.tb) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/six.py", line 703, in reraise 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi raise value 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/oslo_db/api.py", line 142, in wrapper 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi return f(*args, **kwargs) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/db/sqlalchemy/api.py", line 222, in wrapped 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/db/sqlalchemy/api.py", line 1166, in instance_destroy 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi raise exception.ConstraintNotMet() 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi nova.exception.ConstraintNotMet: Constraint not met. 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi Traceback (most recent call last): 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/compute/api.py", line 2157, in _delete 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi if self._delete_while_booting(context, instance): 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/compute/api.py", line 2099, in _delete_while_booting 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi instance.destroy() 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/objects/instance.py", line 659, in destroy 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi reason='host changed') 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi nova.exception.ObjectActionError: Object action destroy failed because: host changed 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi Traceback (most recent call last): 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/api/openstack/wsgi.py", line 671, in wrapped 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi return f(*args, **kwargs) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/api/openstack/compute/servers.py", line 989, in delete 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/api/openstack/compute/servers.py", line 797, in _delete 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi self.compute_api.delete(context, instance) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/compute/api.py", line 224, in inner 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/compute/api.py", line 151, in inner 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/compute/api.py", line 2479, in delete 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi self._delete_instance(context, instance) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/compute/api.py", line 2471, in _delete_instance 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi task_state=task_states.DELETING) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/compute/api.py", line 2194, in _delete 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi self._local_delete_cleanup(context, instance) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi File "/usr/lib/python3.6/site-packages/nova/compute/api.py", line 2111, in _local_delete_cleanup 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi context, instance.uuid) 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi AttributeError: 'NoneType' object has no attribute 'uuid' 2020-08-09 23:54:13.408 11 ERROR nova.api.openstack.wsgi 2020-08-09 23:54:13.413 11 INFO nova.api.openstack.wsgi [req-1305def1-184b-4e3e-9397-a033898bdeb5 9a28aa13588843d7a85454243e67b2f7 0a253617f3f146f3bceaf87cbced627f - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. <class 'AttributeError'>
Not sure what is going wrong there while deleting the server. I am moving it skip list till some one from compute team looks into that.
From API logs,
https:/ /logserver. rdoproject. org/openstack- periodic- integration- stable1/ opendev. org/openstack/ tripleo- ci/master/ periodic- tripleo- ci-centos- 8-ovb-3ctlr_ 1comp-featurese t035-ussuri/ 45d7fc9/ logs/overcloud- controller- 1/var/log/ containers/ nova/nova- api.log. txt.gz
2020-08-09 23:54:13.408 11 ERROR nova.api. openstack. wsgi [req-1305def1- 184b-4e3e- 9397-a033898bde b5 9a28aa13588843d 7a85454243e67b2 f7 0a253617f3f146f 3bceaf87cbced62 7f - default default] Unexpected exception in API method: AttributeError: 'NoneType' object has no attribute 'uuid' openstack. wsgi Traceback (most recent call last): openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/objects/ instance. py", line 655, in destroy openstack. wsgi hard_delete= hard_delete) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/db/ api.py" , line 549, in instance_destroy openstack. wsgi hard_delete= hard_delete) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/db/ sqlalchemy/ api.py" , line 179, in wrapper openstack. wsgi return f(*args, **kwargs) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ oslo_db/ api.py" , line 154, in wrapper openstack. wsgi ectxt.value = e.inner_exc openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ oslo_utils/ excutils. py", line 220, in __exit__ openstack. wsgi self.force_ reraise( ) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ oslo_utils/ excutils. py", line 196, in force_reraise openstack. wsgi six.reraise( self.type_ , self.value, self.tb) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ six.py" , line 703, in reraise openstack. wsgi raise value openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ oslo_db/ api.py" , line 142, in wrapper openstack. wsgi return f(*args, **kwargs) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/db/ sqlalchemy/ api.py" , line 222, in wrapped openstack. wsgi return f(context, *args, **kwargs) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/db/ sqlalchemy/ api.py" , line 1166, in instance_destroy openstack. wsgi raise exception. ConstraintNotMe t() openstack. wsgi nova.exception. ConstraintNotMe t: Constraint not met. openstack. wsgi openstack. wsgi During handling of the above exception, another exception occurred: openstack. wsgi openstack. wsgi Traceback (most recent call last): openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/compute/ api.py" , line 2157, in _delete openstack. wsgi if self._delete_ while_booting( context, instance): openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/compute/ api.py" , line 2099, in _delete_ while_booting openstack. wsgi instance.destroy() openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ oslo_versionedo bjects/ base.py" , line 226, in wrapper openstack. wsgi return fn(self, *args, **kwargs) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/objects/ instance. py", line 659, in destroy openstack. wsgi reason='host changed') openstack. wsgi nova.exception. ObjectActionErr or: Object action destroy failed because: host changed openstack. wsgi openstack. wsgi During handling of the above exception, another exception occurred: openstack. wsgi openstack. wsgi Traceback (most recent call last): openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/api/ openstack/ wsgi.py" , line 671, in wrapped openstack. wsgi return f(*args, **kwargs) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/api/ openstack/ compute/ servers. py", line 989, in delete openstack. wsgi self._delete( req.environ[ 'nova.context' ], req, id) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/api/ openstack/ compute/ servers. py", line 797, in _delete openstack. wsgi self.compute_ api.delete( context, instance) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/compute/ api.py" , line 224, in inner openstack. wsgi return function(self, context, instance, *args, **kwargs) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/compute/ api.py" , line 151, in inner openstack. wsgi return f(self, context, instance, *args, **kw) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/compute/ api.py" , line 2479, in delete openstack. wsgi self._delete_ instance( context, instance) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/compute/ api.py" , line 2471, in _delete_instance openstack. wsgi task_state= task_states. DELETING) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/compute/ api.py" , line 2194, in _delete openstack. wsgi self._local_ delete_ cleanup( context, instance) openstack. wsgi File "/usr/lib/ python3. 6/site- packages/ nova/compute/ api.py" , line 2111, in _local_ delete_ cleanup openstack. wsgi context, instance.uuid) openstack. wsgi AttributeError: 'NoneType' object has no attribute 'uuid' openstack. wsgi openstack. wsgi [req-1305def1- 184b-4e3e- 9397-a033898bde b5 9a28aa13588843d 7a85454243e67b2 f7 0a253617f3f146f 3bceaf87cbced62 7f - default default] HTTP exception thrown: Unexpected API Error. Please report this at http:// bugs.launchpad. net/nova/ and attach the Nova API log if possible.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.408 11 ERROR nova.api.
2020-08-09 23:54:13.413 11 INFO nova.api.
<class 'AttributeError'>
Not sure what is going wrong there while deleting the server. I am moving it skip list till some one from compute team looks into that.