phase 1 failing on No such file or directory: '/home/stack/tempest'

Bug #1819440 reported by Rafael Folco
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Arx Cruz

Bug Description

https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-rocky-rdo_trunk-minimal-118/console.txt.gz

Probably https://review.openstack.org/#/c/639651/15 broke phase 1

2019-03-09 19:12:54.152 | TASK [validate-tempest : Generate testrepository.subunit results file] *********
2019-03-09 19:12:54.152 | task path: /home/jenkins/workspace/tripleo-quickstart-promote-rocky-rdo_trunk-minimal/usr/local/share/ansible/roles/validate-tempest/tasks/tempest-results.yml:33
2019-03-09 19:12:54.175 | Saturday 09 March 2019 19:12:54 +0000 (0:00:01.591) 2:49:02.287 ********
2019-03-09 19:12:55.653 | fatal: [undercloud]: FAILED! => {
2019-03-09 19:12:55.653 | "changed": false,
2019-03-09 19:12:55.653 | "rc": 1
2019-03-09 19:12:55.653 | }
2019-03-09 19:12:55.653 |
2019-03-09 19:12:55.653 | MSG:
2019-03-09 19:12:55.653 |
2019-03-09 19:12:55.653 | MODULE FAILURE
2019-03-09 19:12:55.653 |
2019-03-09 19:12:55.653 |
2019-03-09 19:12:55.653 | MODULE_STDERR:
2019-03-09 19:12:55.653 |
2019-03-09 19:12:55.653 | Warning: Permanently added 'undercloud' (ECDSA) to the list of known hosts.
2019-03-09 19:12:55.654 | Traceback (most recent call last):
2019-03-09 19:12:55.654 | File "/tmp/ansible_NGTkDD/ansible_module_command.py", line 248, in <module>
2019-03-09 19:12:55.654 | main()
2019-03-09 19:12:55.654 | File "/tmp/ansible_NGTkDD/ansible_module_command.py", line 192, in main
2019-03-09 19:12:55.655 | os.chdir(chdir)
2019-03-09 19:12:55.655 | OSError: [Errno 2] No such file or directory: '/home/stack/tempest'

Changed in tripleo:
importance: Undecided → Critical
Changed in tripleo:
assignee: Gabriele Cerami (gcerami) → Arx Cruz (arxcruz)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-quickstart-extras (master)

Fix proposed to branch: master
Review: https://review.openstack.org/642420

Changed in tripleo:
status: Triaged → In Progress
Changed in tripleo:
assignee: Arx Cruz (arxcruz) → wes hayutin (weshayutin)
assignee: wes hayutin (weshayutin) → Arx Cruz (arxcruz)
Changed in tripleo:
assignee: Arx Cruz (arxcruz) → wes hayutin (weshayutin)
Changed in tripleo:
milestone: stein-3 → stein-rc1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.openstack.org/643237

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/rocky)

Reviewed: https://review.openstack.org/643237
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=d0a6cb1d382dffb9e9e5bb56f6a997685ec885c0
Submitter: Zuul
Branch: stable/rocky

commit d0a6cb1d382dffb9e9e5bb56f6a997685ec885c0
Author: Chandan Kumar <email address hidden>
Date: Wed Oct 3 16:04:41 2018 +0530

    Add tempest workspace volume for tempest

    * It also set proper setype for tempest service directories
    This will allow proper access from the containers without any new SELinux policy.

    * /var/lib/tempest will be used for creating tempest workspace.

    Closes-Bug: #1819440

    Change-Id: Iedd397784c8b8d1bb891272542bd242c0ea60340
    (cherry picked from commit 9a1effd90d149ac9df759c0b8ee3d36661acb9f5)

tags: added: in-stable-rocky
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-quickstart-extras (master)

Reviewed: https://review.openstack.org/642420
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/commit/?id=a4b1340a1c8e61ca6a864a908fc2083b68918a7b
Submitter: Zuul
Branch: master

commit a4b1340a1c8e61ca6a864a908fc2083b68918a7b
Author: Arx Cruz <email address hidden>
Date: Mon Mar 11 12:15:10 2019 +0100

    Fix containerized tempest logic

    We weren't testing containerized tempest in standalone job due the
    missing logic on tempest-setup.sh script. This patch adds the logic for
    when containerized tempest runs in standalone, copying the clouds.yaml
    file instead of the stackrc/undercloudrc and also maintain the logic
    when you execute tempest in the ovb, copying the rc file.
    This also ensures that /var/lib/tempestdata and /var/log/tempest
    directories exists in order to not fail the execution of containerized
    tempest.

    https://tree.taiga.io/project/tripleo-ci-board/issue/836

    Depends-On: https://review.openstack.org/#/c/643212/
    Change-Id: I90204150085a1c9b943f9e054c0420a8a5e66538
    Related-Bug: 1819440

wes hayutin (weshayutin)
Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
wes hayutin (weshayutin) wrote :
Changed in tripleo:
status: Fix Released → Triaged
Revision history for this message
wes hayutin (weshayutin) wrote :

I recreated this locally.. will contact arx in the morning.

ASK [validate-tempest : Change permission of tempest container log directory] **************************************************************************************************************************************
task path: /var/tmp/CICENT/usr/local/share/ansible/roles/validate-tempest/tasks/tempest-results.yml:28
Monday 18 March 2019 22:11:57 -0600 (0:00:00.138) 1:41:36.969 **********
changed: [undercloud] => {
    "changed": true,
    "cmd": "sudo chmod -R 777 /var/log/containers/tempest",
    "delta": "0:00:00.028226",
    "end": "2019-03-19 04:11:57.885629",
    "rc": 0,
    "start": "2019-03-19 04:11:57.857403"
}

TASK [validate-tempest : Generate testrepository.subunit results file] **********************************************************************************************************************************************
task path: /var/tmp/CICENT/usr/local/share/ansible/roles/validate-tempest/tasks/tempest-results.yml:33
Monday 18 March 2019 22:11:58 -0600 (0:00:00.884) 1:41:37.853 **********
fatal: [undercloud]: FAILED! => {
    "changed": false,
    "rc": 1
}

MSG:

MODULE FAILURE

MODULE_STDERR:

Warning: Permanently added 'undercloud' (ECDSA) to the list of known hosts.
Traceback (most recent call last):
  File "/tmp/ansible_Bsgzuv/ansible_module_command.py", line 248, in <module>
    main()
  File "/tmp/ansible_Bsgzuv/ansible_module_command.py", line 192, in main
    os.chdir(chdir)
OSError: [Errno 2] No such file or directory: '/home/stack/tempest'

PLAY RECAP ******************************************************************************

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-quickstart-extras (master)

Fix proposed to branch: master
Review: https://review.openstack.org/644578

Changed in tripleo:
assignee: wes hayutin (weshayutin) → Arx Cruz (arxcruz)
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-quickstart-extras (master)

Reviewed: https://review.openstack.org/644578
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/commit/?id=1ed9b910ff28e84ab445f3003122feaeb3d58d2e
Submitter: Zuul
Branch: master

commit 1ed9b910ff28e84ab445f3003122feaeb3d58d2e
Author: Arx Cruz <email address hidden>
Date: Tue Mar 19 14:57:37 2019 +0100

    Changing the way you copy tempest data to shell

    The copy module look for a directory or file locally, and copy to remote
    machine. In upstream, this code works, because we run quickstart in the
    undercloud machine. However, if you're running quickstart on a different
    machine, it will try to search locally for /var/lib/tempestdata, which
    doesn't exist. Use remote_src doesn't work for recursive directory. The
    other option was to use synchronize but it's very slow for recursive
    directories. The best option is to use command to copy locally.

    https://tree.taiga.io/project/tripleo-ci-board/issue/836?kanban-status=2027734

    Change-Id: I589241e657178909b115fcfdca907ac16dc79b71
    Closes-Bug: 1819440

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-quickstart-extras 2.1.1

This issue was fixed in the openstack/tripleo-quickstart-extras 2.1.1 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 9.4.0

This issue was fixed in the openstack/tripleo-heat-templates 9.4.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.