Quantum smoke tests do not target running VMs

Bug #1043980 reported by Maru Newby
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tempest
Fix Released
Undecided
Maru Newby

Bug Description

The current Quantum smoke tests validate only the network state as Quantum understands it, not the network configuration of running VMs. A more comprehensive evaluation would be modelled after tempest's test_basic_server_ops and devstack's quantum-advtest.sh

See:

https://github.com/openstack/tempest/blob/051075a59642e0d2f98a4ab792a52523e3478159/tempest/tests/compute/test_server_basic_ops.py
https://github.com/openstack-dev/devstack/blob/ea23e686643778ae9e421e3772f8f93e127c383f/exercises/quantum-adv-test.sh).

Maru Newby (maru)
Changed in tempest:
assignee: nobody → Maru Newby (maru)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tempest (master)

Fix proposed to branch: master
Review: https://review.openstack.org/12208

Changed in tempest:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/12484

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/12485

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tempest (master)

Reviewed: https://review.openstack.org/12208
Committed: http://github.com/openstack/tempest/commit/dec13ecf620127c0a6530724784195535cf5e9b4
Submitter: Jenkins
Branch: master

commit dec13ecf620127c0a6530724784195535cf5e9b4
Author: Maru Newby <email address hidden>
Date: Thu Aug 30 11:19:17 2012 -0700

    Provide more default clients for smoke tests.

     * Refactored DefaultClientManager to support default clients
       for image, identity and network in addition to compute. This
       change is intended to faciliate the creation of
       cross-functional smoke tests.
     * In support of bug 1043980

    Change-Id: I45c0e6bf5fde41936df8838b7434c0b2074f4a02

Changed in tempest:
status: In Progress → Fix Committed
Maru Newby (maru)
Changed in tempest:
status: Fix Committed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/12484
Committed: http://github.com/openstack/tempest/commit/d3bf0aa06f7d2c51ba3311ec5c369936936c048d
Submitter: Jenkins
Branch: master

commit d3bf0aa06f7d2c51ba3311ec5c369936936c048d
Author: Maru Newby <email address hidden>
Date: Wed Sep 5 20:01:43 2012 -0700

    Refactor status_timeout() methods in tempest.test

     * Factor timing loop out of status_timeout() methods to new method
       call_until_true() to allow for reuse.
     * In support of bug 1043980

    Change-Id: I2271000278918bd87fea66cb810f2dad0af4ffdd

Changed in tempest:
status: In Progress → Fix Committed
Maru Newby (maru)
Changed in tempest:
status: Fix Committed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tempest (master)

Fix proposed to branch: master
Review: https://review.openstack.org/18105

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tempest (master)

Reviewed: https://review.openstack.org/18105
Committed: http://github.com/openstack/tempest/commit/b72f37cfb4d6591205abfe4df0c33df62a8e04d9
Submitter: Jenkins
Branch: master

commit b72f37cfb4d6591205abfe4df0c33df62a8e04d9
Author: Maru Newby <email address hidden>
Date: Fri Dec 14 02:17:06 2012 +0000

    Add admin credential config for network client.

     * Supports bug 1043980

    Change-Id: I5ffc2d57a19e9f3a8112308998f0b957b7d93b1f

Changed in tempest:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/12485
Committed: http://github.com/openstack/tempest/commit/81f07a09ba779b0cfaa2a27f8acfbe339c48adce
Submitter: Jenkins
Branch: master

commit 81f07a09ba779b0cfaa2a27f8acfbe339c48adce
Author: Maru Newby <email address hidden>
Date: Wed Sep 5 20:21:19 2012 -0700

    Add smoke tests for quantum.

     * Added test_network_basic_ops, a port of the devstack exercise
       script quantum-adv-test.sh.
     * Tenant network connectivity can be tested by setting
       the 'tenant_networks_reachable' key in tempest.conf to 'true'.
     * Public (floating ip) connectivity can be tested by setting the
       'public_network_id' key in tempest.conf.
     * Addresses bug 1043980

    Change-Id: I506518c431a8da0b91e3044f2a6aabce48081d93

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.