Comment 2 for bug 1957031

Revision history for this message
chandan kumar (chkumar246) wrote :

Just for record, fs035 cs9 job tempest tests are failing with similar error
https://logserver.rdoproject.org/40/37740/5/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/565e24c/logs/undercloud/var/log/tempest/failing_tests.log.txt.gz

``
tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server_with_volume_attached[id-b68bd8d6-855d-4212-b59b-2e704044dace,slow,volume]
tempest.api.compute.servers.test_server_rescue_negative.ServerRescueNegativeTestJSON.test_rescued_vm_detach_volume[id-f56e465b-fe10-48bf-b75d-646cda3a8bc9,negative,volume]
tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume[id-52e9045a-e90d-4c0d-9087-79d657faffff,slow]
tearDownClass (tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON)
tearDownClass (tempest.api.compute.servers.test_server_rescue_negative.ServerRescueNegativeTestJSON)
tempest.api.compute.volumes.test_attach_volume.AttachVolumeShelveTestJSON.test_attach_volume_shelved_or_offload_server[id-13a940b6-3474-4c3c-b03f-29b89112bfee,slow]

```
and reason is same
https://logserver.rdoproject.org/40/37740/5/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/565e24c/logs/overcloud-novacompute-0/var/log/extra/errors.txt.gz

```
2022-01-13 03:08:18.987 ERROR /var/log/containers/nova/nova-compute.log: 2 ERROR oslo_messaging.rpc.server nova.exception.DeviceDetachFailed: Device detach failed for vdb: Run out of retry while detaching device vdb with device alias virtio-disk1 from instance 57bfbbad-a9f5-44b0-8e0d-c0654b09cf6a from the live domain config. Device is still attached to the guest.
2022-01-13 03:08:18.987 ERROR /var/log/containers/nova/nova-compute.log: 2 ERROR oslo_messaging.rpc.server
2022-01-13 03:08:30.924 ERROR /var/log/containers/nova/nova-compute.log: 2 ERROR nova.virt.libvirt.driver [req-15edbb6f-f30f-4ba9-bb39-fc46116cbeae 6b315983f378482694c92f0a035e34f9 c845819458e847c0a49d5e9e0d71c029 - default default] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 888d9eb4-7737-421f-867a-d14b1e430929 is timed out.
2022-01-13 03:08:30.928 ERROR /var/log/containers/nova/nova-compute.log: 2 ERROR nova.virt.libvirt.driver [req-15edbb6f-f30f-4ba9-bb39-fc46116cbeae 6b315983f378482694c92f0a035e34f9 c845819458e847c0a49d5e9e0d71c029 - default default] Run out of retry while detaching device vdb with device alias virtio-disk1 from instance 888d9eb4-7737-421f-867a-d14b1e430929 from the live domain config. Device is still attached to the guest.
2022-01-13 03:08:31.058 ERROR /var/log/containers/nova/nova-compute.log: 2 ERROR oslo_messaging.rpc.server [req-15edbb6f-f30f-4ba9-bb39-fc46116cbeae 6b315983f378482694c92f0a035e34f9 c845819458e847c0a49d5e9e0d71c029 - default default] Exception during message handling: nova.exception.DeviceDetachFailed: Device detach failed for vdb: Run out of retry while detaching device vdb with device alias virtio-disk1 from instance 888d9eb4-7737-421f-867a-d14b1e430929 from the live domain config. Device is still attached to the guest.
```