gate-tempest-dsvm-layer4 fails with "EndpointNotFound: internalURL endpoint for compute service not found"

Bug #1573868 reported by Matt Riedemann
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Sahara
Fix Released
Low
Vitalii Gridnev
devstack
Invalid
Undecided
Unassigned

Bug Description

http://logs.openstack.org/18/307518/2/check/gate-tempest-dsvm-layer4/bbfacfd/logs/screen-sahara-api.txt.gz?level=TRACE

2016-04-22 22:40:41.881 682 ERROR sahara.utils.api [req-1af91083-c5ca-42e0-a0a8-e85b2a8f53e1 da4552da2dd348d885da3434f42332fa 49a5fbd8ae934335b86cc72dfb436395 - - -] Request aborted with status code 500 and message 'Error occurred during validation'
2016-04-22 22:40:41.884 682 ERROR sahara.utils.api [req-1af91083-c5ca-42e0-a0a8-e85b2a8f53e1 da4552da2dd348d885da3434f42332fa 49a5fbd8ae934335b86cc72dfb436395 - - -] Traceback (most recent call last):
  File "/opt/stack/new/sahara/sahara/service/validation.py", line 55, in handler
    validator(**kwargs)
  File "/opt/stack/new/sahara/sahara/service/validations/node_group_templates.py", line 30, in check_node_group_template_create
    data['hadoop_version'], data)
  File "/opt/stack/new/sahara/sahara/service/validations/base.py", line 133, in check_node_group_basic_fields
    check_flavor_exists(ng['flavor_id'])
  File "/opt/stack/new/sahara/sahara/service/validations/base.py", line 167, in check_flavor_exists
    flavor_list = nova.client().flavors.list()
  File "/usr/local/lib/python2.7/dist-packages/novaclient/v2/flavors.py", line 132, in list
    return self._list("/flavors%s%s" % (detail, query_string), "flavors")
  File "/usr/local/lib/python2.7/dist-packages/novaclient/base.py", line 242, in _list
    resp, body = self.api.client.get(url)
  File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 173, in get
    return self.request(url, 'GET', **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 95, in request
    **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 330, in request
    resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 98, in request
    return self.session.request(url, method, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
    return wrapped(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/session.py", line 341, in request
    base_url = self.get_endpoint(auth, **endpoint_filter)
  File "/usr/local/lib/python2.7/dist-packages/keystoneclient/session.py", line 681, in get_endpoint
    return auth.get_endpoint(self, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 213, in get_endpoint
    service_name=service_name)
  File "/usr/local/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
    return wrapped(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/access/service_catalog.py", line 228, in url_for
    raise exceptions.EndpointNotFound(msg)

We don't index the sahara job logs so I'm not sure when this started, but it's a tempest change that's not related to sahara which failed in the gate.

Revision history for this message
Matt Riedemann (mriedem) wrote :
Revision history for this message
Matt Riedemann (mriedem) wrote :

Looks like it was this change in devstack: https://review.openstack.org/#/c/309398/

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to devstack (master)

Fix proposed to branch: master
Review: https://review.openstack.org/309633

Changed in devstack:
assignee: nobody → Matt Riedemann (mriedem)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to devstack (master)

Reviewed: https://review.openstack.org/309633
Committed: https://git.openstack.org/cgit/openstack-dev/devstack/commit/?id=ae4578bed986ebaaf3e09e1ecc9d4d7ae9f022ab
Submitter: Jenkins
Branch: master

commit ae4578bed986ebaaf3e09e1ecc9d4d7ae9f022ab
Author: Matt Riedemann <email address hidden>
Date: Sat Apr 23 01:45:40 2016 +0000

    Revert "Don't check for existing endpoints"

    This reverts commit 7d1ec430046256ac3f536f4920a43936e28ef0c4.

    This broke the sahara and layer4 dsvm jobs. The layer4 job
    is voting on tempest changes so tempest is also broken.

    Change-Id: Ide69f10cd85bf7ff0d86bc8cba56dedd26850362
    Partial-Bug: #1573868

Revision history for this message
Vitalii Gridnev (vgridnev) wrote :

Hi, by default sahara communicate with other services like nova / cinder and so on using internalUrl. So, the only thing we need then is to configure sahara in devstack to use publicUrl for other services.

Revision history for this message
Jordan Pittier (jordan-pittier) wrote :

I think Sahara should communicate with other services using adminURL, not public URL.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on sahara (master)

Change abandoned by Jordan Pittier (<email address hidden>) on branch: master
Review: https://review.openstack.org/309712
Reason: I don't have time nor interest for this.

Matt Riedemann (mriedem)
Changed in devstack:
status: In Progress → Confirmed
assignee: Matt Riedemann (mriedem) → nobody
Revision history for this message
Vitalii Gridnev (vgridnev) wrote :
Changed in sahara:
status: New → In Progress
importance: Undecided → Low
assignee: nobody → Vitaly Gridnev (vgridnev)
milestone: none → newton-2
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to sahara (master)

Reviewed: https://review.openstack.org/316173
Committed: https://git.openstack.org/cgit/openstack/sahara/commit/?id=890f3416ce25c3e860124f0570599b25ca14ecf5
Submitter: Jenkins
Branch: master

commit 890f3416ce25c3e860124f0570599b25ca14ecf5
Author: Vitaly Gridnev <email address hidden>
Date: Fri May 13 19:01:54 2016 +0300

    ability to configure endpoint type for services

    this adds ability to configure endpoint type for
    services in devstack by addition of new option for
    that.

    Closes-bug: 1573868
    Change-Id: I9dfa6b636aeb1efb781fa20c674b39a6d2cda01f

Changed in sahara:
status: In Progress → Fix Released
Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/sahara 5.0.0.0b2

This issue was fixed in the openstack/sahara 5.0.0.0b2 development milestone.

Changed in devstack:
status: Confirmed → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.