tempest

Tempest heat tests- test_neutron_resources fails

Bug #1547261 reported by Ghanshyam Mann on 2016-02-18

This bug report is a duplicate of: Bug #1546201: Race condition: boot a server on a network created by Heat. Edit Remove

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	tempest	In Progress	Undecided	Steve Baker

Bug Description

Seeing failure on layer4 tests gate job

ft2.1: setUpClass (tempest.api.orchestration.stacks.test_neutron_resources.NeutronResourcesTestJSON)_StringException: Traceback (most recent call last):
  File "tempest/test.py", line 262, in setUpClass
    six.reraise(etype, value, trace)
  File "tempest/test.py", line 255, in setUpClass
    cls.resource_setup()
  File "tempest/api/orchestration/stacks/test_neutron_resources.py", line 78, in resource_setup
    cls.client.wait_for_stack_status(cls.stack_id, 'CREATE_COMPLETE')
  File "tempest/services/orchestration/json/orchestration_client.py", line 210, in wait_for_stack_status
    stack_status_reason=body['stack_status_reason'])
tempest.exceptions.StackBuildErrorException: Stack 6f14f8b2-493d-4b01-a4a2-e72c3f8d92af is in CREATE_FAILED status due to 'Resource CREATE failed: BadRequest: resources.Server: Network 1d27295a-778b-4138-bafe-e9ef8260fb68 requires a subnet in order to boot instances on. (HTTP 400) (Request-ID: req-8d80d330-a77a-4c5d-87dd-65d8b9a1b91e)'

http://logs.openstack.org/36/281036/2/gate/gate-tempest-dsvm-layer4/b9a22c1/logs/testr_results.html.gz

Revision history for this message

Ghanshyam Mann (ghanshyammann) wrote on 2016-02-19:

Download full text (3.6 KiB)

From heat engine logs-

I did not find any call to create subnet on that network-

mentioned network created-
http://logs.openstack.org/36/281036/2/gate/gate-tempest-dsvm-layer4/b9a22c1/logs/screen-h-eng.txt.gz#_2016-02-18_08_29_05_106

Fail to find subnet-
http://logs.openstack.org/36/281036/2/gate/gate-tempest-dsvm-layer4/b9a22c1/logs/screen-h-eng.txt.gz#_2016-02-18_08_29_06_320

2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource Traceback (most recent call last):
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/opt/stack/new/heat/heat/engine/resource.py", line 644, in _action_recorder
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource yield
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/opt/stack/new/heat/heat/engine/resource.py", line 715, in _do_action
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource yield self.action_handler_task(action, args=handler_args)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/opt/stack/new/heat/heat/engine/scheduler.py", line 295, in wrapper
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource step = next(subtask)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/opt/stack/new/heat/heat/engine/resource.py", line 686, in action_handler_task
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource handler_data = handler(*args)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/opt/stack/new/heat/heat/engine/resources/openstack/nova/server.py", line 793, in handle_create
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource admin_pass=admin_pass)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/usr/local/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1038, in create
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource **boot_kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/usr/local/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 555, in _boot
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource return_raw=return_raw, **kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/usr/local/lib/python2.7/dist-packages/novaclient/base.py", line 302, in _create
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource _resp, body = self.api.client.post(url, body=body)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 451, in post
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource return self._cs_request(url, 'POST', **kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 426, in _cs_request
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource resp, body = self._time_request(url, method, **kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 399, in _time_request
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource resp, body = self.request(url, method, **kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.re...

From heat engine logs-

I did not find any call to create subnet on that network-

mentioned network created-
http://logs.openstack.org/36/281036/2/gate/gate-tempest-dsvm-layer4/b9a22c1/logs/screen-h-eng.txt.gz#_2016-02-18_08_29_05_106

Fail to find subnet-
http://logs.openstack.org/36/281036/2/gate/gate-tempest-dsvm-layer4/b9a22c1/logs/screen-h-eng.txt.gz#_2016-02-18_08_29_06_320

2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource Traceback (most recent call last):
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/opt/stack/new/heat/heat/engine/resource.py", line 644, in _action_recorder
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     yield
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/opt/stack/new/heat/heat/engine/resource.py", line 715, in _do_action
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     yield self.action_handler_task(action, args=handler_args)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/opt/stack/new/heat/heat/engine/scheduler.py", line 295, in wrapper
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     step = next(subtask)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/opt/stack/new/heat/heat/engine/resource.py", line 686, in action_handler_task
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     handler_data = handler(*args)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/opt/stack/new/heat/heat/engine/resources/openstack/nova/server.py", line 793, in handle_create
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     admin_pass=admin_pass)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/usr/local/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1038, in create
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     **boot_kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/usr/local/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 555, in _boot
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     return_raw=return_raw, **kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/usr/local/lib/python2.7/dist-packages/novaclient/base.py", line 302, in _create
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     _resp, body = self.api.client.post(url, body=body)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 451, in post
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     return self._cs_request(url, 'POST', **kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 426, in _cs_request
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     resp, body = self._time_request(url, method, **kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 399, in _time_request
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     resp, body = self.request(url, method, **kwargs)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource   File "/usr/local/lib/python2.7/dist-packages/novaclient/client.py", line 393, in request
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource     raise exceptions.from_response(resp, body, url, method)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource BadRequest: Network 1d27295a-778b-4138-bafe-e9ef8260fb68 requires a subnet in order to boot instances on. (HTTP 400) (Request-ID: req-8d80d330-a77a-4c5d-87dd-65d8b9a1b91e)
2016-02-18 08:29:06.320 21636 ERROR heat.engine.resource

Changed in tempest:
status:	New → Invalid

Revision history for this message

Ghanshyam Mann (ghanshyammann) wrote on 2016-02-19:

22 failure it seems-

http://status.openstack.org/openstack-health/#/test/setUpClass%20(tempest.api.orchestration.stacks.test_neutron_resources.NeutronResourcesTestJSON)?resolutionKey=hour&duration=P7D

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-02-22: Related fix proposed to tempest (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/283238

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-02-23: Related fix merged to tempest (master)

Reviewed: https://review.openstack.org/283238
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=e16d08edff7c4a37e359fd0a3cadfcc005db745d
Submitter: Jenkins
Branch: master

commit e16d08edff7c4a37e359fd0a3cadfcc005db745d
Author: Ghanshyam <email address hidden>
Date: Tue Feb 23 05:05:58 2016 +0900

Skip Heat neutron tests

Heat neutron resource stack tests are failing continuously
on gate. Failure is because of not creating the subnet on network.

This commit skip all tests till bug 1547261 is fixed.

Change-Id: I5317f1cc7ebba26a926898dc54e0109a98ca181f
Related-Bug: #1547261

Matt Riedemann (mriedem) on 2016-02-24

Changed in heat:
status:	New → Confirmed

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-06-27: Fix proposed to tempest (master)

Fix proposed to branch: master
Review: https://review.openstack.org/334270

Changed in tempest:
assignee:	nobody → Steve Baker (steve-stevebaker)
status:	Invalid → In Progress

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-08-04: Change abandoned on tempest (master)

Change abandoned by Steve Baker (<email address hidden>) on branch: master
Review: https://review.openstack.org/334270
Reason: This test can be deleted now

Steve Baker (steve-stevebaker) on 2016-08-04

no longer affects:

heat

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-08-04: Fix proposed to tempest (master)

Fix proposed to branch: master
Review: https://review.openstack.org/351426

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-09-23: Change abandoned on tempest (master)

Change abandoned by Steve Baker (<email address hidden>) on branch: master
Review: https://review.openstack.org/351426

Report a bug

This report contains Public information

Everyone can see this information.

Duplicate of bug #1546201 Remove

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.