kolla

[centos-binary-rocky-xenapi] openstack command failed in nova-compute container

Bug #1837767 reported by James
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Won't Fix
Medium
James
Rocky
Won't Fix
Medium
James
Stein
Won't Fix
Medium
James
Train
Won't Fix
Medium
James

Bug Description

My kolla-ansible has failed at the for a xen hypervisor TASK [nova : Waiting for nova-compute service up] **********************************************************************************************************************************************************
FAILED - RETRYING: Waiting for nova-compute service up (20 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (19 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (18 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (17 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (16 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (15 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (14 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (13 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (12 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (11 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (10 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (9 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (8 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (7 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (6 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (5 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (4 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (3 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (2 retries left).
FAILED - RETRYING: Waiting for nova-compute service up (1 retries left).
fatal: [192.168.1.40 -> 192.168.1.40]: FAILED! => {"attempts": 20, "changed": false, "cmd": ["docker", "exec", "kolla_toolbox", "openstack", "--os-interface", "internal", "--os-auth-url", "http://192.168.1.250:35357", "--os-identity-api-version", "3", "--os-project-domain-name", "default", "--os-tenant-name", "admin", "--os-username", "admin", "--os-password", "openstack", "--os-user-domain-name", "default", "compute", "service", "list", "-f", "json", "--service", "nova-compute"], "delta": "0:00:02.187989", "end": "2019-07-24 18:02:33.893363", "rc": 0, "start": "2019-07-24 18:02:31.705374", "stderr": "", "stderr_lines": [], "stdout": "[]", "stdout_lines": ["[]"]}

Tailing the nova-compute logs you can see that os_xenapi python package does not exist in the nova_compute container:
tail -F /var/log/kolla/nova/nova-compute.log
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver File "/usr/lib/python2.7/site-packages/oslo_utils/importutils.py", line 44, in import_object
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver return import_class(import_str)(*args, **kwargs)
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver File "/usr/lib/python2.7/site-packages/oslo_utils/importutils.py", line 30, in import_class
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver __import__(mod_str)
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver File "/usr/lib/python2.7/site-packages/nova/virt/xenapi/__init__.py", line 19, in <module>
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver from nova.virt.xenapi import driver
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver File "/usr/lib/python2.7/site-packages/nova/virt/xenapi/driver.py", line 28, in <module>
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver from os_xenapi.client import session
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver ImportError: No module named os_xenapi.client
2019-07-24 14:06:23.766 5 ERROR nova.virt.driver
2019-07-24 14:13:18.803 5 INFO os_vif [-] Loaded VIF plugins: ovs, linux_bridge, noop
2019-07-24 14:13:19.086 5 INFO nova.virt.driver [req-6643aa6d-570f-47a5-86be-419746e79c2f - - - - -] Loading compute driver 'xenapi.XenAPIDriver'
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver [req-6643aa6d-570f-47a5-86be-419746e79c2f - - - - -] Unable to load the virtualization driver: ImportError: No module named os_xenapi.client
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver Traceback (most recent call last):
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver File "/usr/lib/python2.7/site-packages/nova/virt/driver.py", line 1747, in load_compute_driver
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver virtapi)
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver File "/usr/lib/python2.7/site-packages/oslo_utils/importutils.py", line 44, in import_object
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver return import_class(import_str)(*args, **kwargs)
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver File "/usr/lib/python2.7/site-packages/oslo_utils/importutils.py", line 30, in import_class
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver __import__(mod_str)
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver File "/usr/lib/python2.7/site-packages/nova/virt/xenapi/__init__.py", line 19, in <module>
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver from nova.virt.xenapi import driver
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver File "/usr/lib/python2.7/site-packages/nova/virt/xenapi/driver.py", line 28, in <module>
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver from os_xenapi.client import session
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver ImportError: No module named os_xenapi.client
2019-07-24 14:13:19.088 5 ERROR nova.virt.driver

Revision history for this message
James (james-o-benson) wrote :

Globals file: http://paste.ubuntu.com/p/cJnrbpTTST/

Revision history for this message
Radosław Piliszek (yoctozepto) wrote :

xen is not tested in CI, could be broken in any release now - to check

summary: - openstack command failed in nova-compute container
+ [centos-binary-rocky-xenapi] openstack command failed in nova-compute
+ container
Revision history for this message
Mark Goddard (mgoddard) wrote :

Did you fix this issue James?

Michal Nasiadka (mnasiadka)
Changed in kolla:
status: New → Incomplete
Revision history for this message
James (james-o-benson) wrote :

Mark, not yet but I am still working on it. It's a long process. I've fixed several problems between nova and neutron, however, still have some neutron issues to resolve. It would go tremendously faster if I could reach out to someone who has/does deploy using Xen. The big issue is that there are some configurations that are hard to figure out without prior experience using Xen OpenStack and what it is looking to retrieve for a proper deployment.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (master)

Fix proposed to branch: master
Review: https://review.opendev.org/682470

Changed in kolla:
assignee: nobody → James (james-o-benson)
status: Incomplete → In Progress
Revision history for this message
Mark Goddard (mgoddard) wrote :

Hi James, are you planning to continue working on this?

Revision history for this message
James (james-o-benson) wrote :

Mark, Yes, but it might take a while. We can keep it open or close it while I try to figure out exactly how to fix it. I'll update my OpenStack attempts to Train now that it is released.

Revision history for this message
Radosław Piliszek (yoctozepto) wrote :

xenapi got deprecated and rocky goes em

Changed in kolla:
status: In Progress → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.