tempest

testr lists both tests and unit tests in gate-tempest-python27 job

Bug #1260710 reported by Andrea Frittoli
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tempest
Fix Released
High
Matthew Treinish
tempest icehouse-2

Bug Description

I hit this issue while working on input-scenario bp for tempest [0], [1].

The idea of the blueprint is to multiply scenario tests based on dynamic data such as the list of images / flavors.
Generating the list of tests requires tempest.conf being available.

With my change in, the gate-tempest-python27 fails when trying to list tests, because tempest.conf is not available. The box where the job runs is not a devstack box, thus tempest.conf is not available.

gate-tempest-python27 should only try to list the unit tests (tempest.tests) rather than the entire list of tests used included in tempest, which is not relevant for testing tempest.

If the complete list of tests is really needed by the job, it should provide a tempest.conf by copying tempest.conf.sample, or setting the TEMPEST_CONFIG environment variable.

[0] https://review.openstack.org/#/c/60434/
[1] https://blueprints.launchpad.net/openstack/?searchtext=input-scenarios-for-scenario

See original description
Revision history for this message
Andrea Frittoli (andrea-frittoli) wrote :

2013-12-13 09:28:12.604 | running=OS_STDOUT_CAPTURE=${OS_STDOUT_CAPTURE:-1} \
2013-12-13 09:28:12.604 | OS_STDERR_CAPTURE=${OS_STDERR_CAPTURE:-1} \
2013-12-13 09:28:12.605 | OS_TEST_TIMEOUT=${OS_TEST_TIMEOUT:-500} \
2013-12-13 09:28:12.605 | ${PYTHON:-python} -m subunit.run discover -t ./ ./tempest --list
2013-12-13 09:28:12.605 | error: testr failed (3)
2013-12-13 09:28:12.618 | ERROR: InvocationError: '/home/jenkins/workspace/gate-tempest-python27/.tox/py27/bin/python setup.py test --slowest --testr-arg=tempest\\.tests '

summary: - tempest.conf is not generated for gate-tempest-python27 job
+ testr lists both tests and unit tests in gate-tempest-python27 job
description: updated
Andrea Frittoli (andrea-frittoli)
no longer affects: openstack-ci
OpenStack Infra (hudson-openstack)
Changed in tempest:
assignee: nobody → Matthew Treinish (treinish)
status: New → In Progress
Sean Dague (sdague)
Changed in tempest:
importance: Undecided → High
milestone: none → icehouse-2
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tempest (master)

Reviewed: https://review.openstack.org/62019
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=bf47061e03e792bf9f107a653a4f5f696d24a650
Submitter: Jenkins
Branch: master

commit bf47061e03e792bf9f107a653a4f5f696d24a650
Author: Matthew Treinish <email address hidden>
Date: Fri Dec 13 15:46:44 2013 +0000

    Add new env variable to specify test path

    This commit adds the env variable OS_TEST_PATH to specify the test
    discovery path for testr. This can be used to specify which path will
    be used for test discovery.
    Closes-Bug: #1260710

    Change-Id: Idcc8f6b5d82a2adc1a1f8ad04a47e8d694dc7de7

Changed in tempest:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.