tripleo

Remove mistral tempest tests jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb

Bug #1736252 reported by Matt Young
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Matthew Young
tripleo queens-3

Bug Description

tempest failures observed on current master hash:

- https://trunk.rdoproject.org/centos7/ac/82/ac82ea9271a4ae3860528eaf8a813da7209e62a6_28eeb6c7

- https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56/tempest.html
- https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56/stackviz/#/stdin
- https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56/undercloud/home/stack/tempest_output.log.txt.gz

Failed Tests

```
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions[id-2e1a578a-1c27-409a-96be-84b5c41498cd,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_equal_to_filter[id-9a53af71-8f1e-4ad5-b572-2c4c621715c0,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_greater_than_equal_to_filter[id-7f598dba-f169-47ec-a487-f0ed31484aff,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_greater_than_filter[id-20b3d527-447d-492b-8cb7-ac5e3757d7d5,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_in_list_filter[id-84823a84-5caa-427d-8a2c-622a1d1893b1,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_less_than_equal_to_filter[id-1fda6c31-b0c3-4b78-9f67-b920e1f6c973,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_less_than_filter[id-874fb57d-a762-4dc3-841d-396657510d23,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_multiple_filter[id-cbb716f1-7fc7-4884-8fa9-6ff2bc35ee29,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_equal_to_filter[id-3c3d28ce-9490-41ae-a918-c28f843841e1,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_not_in_list_filter[id-4b05dfcf-ef39-4032-9528-c8422c7329dd,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_actions.ActionTestsV2.test_get_list_actions_with_pagination[id-786ee85c-c32d-4ac9-8f45-79ab6bc47ef1,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workbooks.WorkbookTestsV2.test_get_list_workbooks[id-4d8752b9-8d69-4d81-8710-5dd8ef699b95,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_cron_triggers.CronTriggerTestsV2.test_get_list_cron_triggers[id-c53b44dd-59b3-4a4b-b22a-21abb4cecea0,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_executions.ExecutionTestsV2.test_get_list_executions[id-c0b4b658-6f01-4680-b402-2f683b3d78b6,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_executions.ExecutionTestsV2.test_get_list_executions_with_pagination[id-0bfcb4b0-b1e4-4499-b81b-0e86c8a2a841,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_tasks.TasksTestsV2.test_get_tasks_list[id-81159dce-3802-44ee-a8d4-5ddca106fd91,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_other_project_private_workflows[id-b8dc1b02-8509-45e2-9df7-4630cdcfa1ab,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows[id-e9cd6817-e8d1-4604-ba76-b0e17219f4c5,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows_by_admin[id-be8a4a44-eeb3-48e3-b11d-b83ba14dbf2c,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows_with_fields[id-2063143b-ced8-4037-9383-e2504be581e6,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows_with_pagination[id-81f28735-e74e-4dc1-8b94-b548f8a80556,smoke] (subunit.RemotedTestCase)
mistral_tempest_tests.tests.api.v2.test_workflows.WorkflowTestsV2.test_get_list_workflows_with_project_by_admin[id-c9e2ebbc-02aa-4c33-b244-e471c8266aa7,smoke] (subunit.RemotedTestCase)
```

Matt Young (halcyondude)
Changed in tripleo:
importance: Undecided → Critical
status: New → Triaged
tags: added: quickstart
tags: added: promotion-blocker
Changed in tripleo:
milestone: none → queens-3
Revision history for this message
Emilien Macchi (emilienm) wrote :

This bug is invalid, jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56 doesn't run Mistral. https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-virtbasic-1ctlr_1comp_64gb-56/overcloud-controller-0/var/log/

Changed in tripleo:
status: Triaged → Invalid
Revision history for this message
wes hayutin (weshayutin) wrote :

Matt, please update the tempest configuration to exclude mistral

Changed in tripleo:
status: Invalid → Triaged
assignee: nobody → Matthew Young (myoung)
summary: - tempest failures: mistral
+ Remove mistral tempest tests jenkins-periodic-master-rdo_trunk-
+ virtbasic-1ctlr_1comp_64gb
Revision history for this message
Matt Young (halcyondude) wrote :

The current configuration in TQE is:

A prior change / issue happened back in August where we set what is running in RDO phase 2.

- https://trello.com/c/WS7Ef3S1/580-update-tempest-to-match-what-qe-is-expecting
- https://review.openstack.org/#/c/491794

The linked review was an attempt to put upstream what we need for OSP, which was the import criteria for OSP. We did this so when rdophase2 promotes, we are sure that osp phase 1 criteria for tempest tests is met. That regex/criteria is:

test_regex: smoke|test_minimum_basic|test_network_basic_ops|test_snapshot_pattern|test_volume_boot_pattern

vs the upstream TQE role default:

test_regex: smoke

-

What's the "source of truth" here for what this regex should be for rdophase2?

Revision history for this message
Matt Young (halcyondude) wrote :

The fix here isn't to disable (explicitly) mistral tests from the job definition, but to stop installing tempest test plugins (like https://github.com/openstack/mistral/tree/master/mistral_tempest_tests)

add nova and neutron tempest plugins to default config
https://review.openstack.org/#/c/525657

stop installing plugins in convert image
https://review.openstack.org/#/c/525659/

Revision history for this message
Matt Young (halcyondude) wrote :

https://review.openstack.org/#/c/525659 is still in the gates. blacklisting mistral for these tests in the meantime.

Revision history for this message
Matt Young (halcyondude) wrote :

These patches have landed, afaik this bug is resolved...

Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.