OpenStack Dashboard (Horizon)

integration tests failing blocking gate

Bug #1436903 reported by David Lyle
30
This bug affects 5 people
Affects Status Importance Assigned to Milestone
OpenStack Dashboard (Horizon)
Fix Released
Critical
David Lyle
OpenStack Dashboard (Horizon) 8.0.0 "liberty"

Bug Description

Sample output, seen in multiple jobs:

2015-03-26 06:35:08.895 | 2015-03-26 06:35:08.886 | Running Horizon integration tests...
2015-03-26 06:35:09.327 | 2015-03-26 06:35:09.318 |
2015-03-26 06:35:09.329 | 2015-03-26 06:35:09.320 | TestDashboardHelp
2015-03-26 06:35:29.765 | 2015-03-26 06:35:29.756 | test_dashboard_help_redirection OK  20.44
2015-03-26 06:35:29.767 | 2015-03-26 06:35:29.758 | TestFlavors
2015-03-26 06:38:45.903 | 2015-03-26 06:38:45.891 | test_flavor_create OK  196.13
2015-03-26 06:38:45.904 | 2015-03-26 06:38:45.892 | TestImage
2015-03-26 06:41:38.835 | 2015-03-26 06:41:38.818 | test_image_create_delete OK  172.93
2015-03-26 06:41:38.837 | 2015-03-26 06:41:38.820 | TestKeypair
2015-03-26 06:43:03.270 | 2015-03-26 06:43:03.250 | test_keypair OK  84.43
2015-03-26 06:43:03.272 | 2015-03-26 06:43:03.251 | TestLogin
2015-03-26 06:43:11.166 | 2015-03-26 06:43:11.145 | test_login OK  7.89
2015-03-26 06:43:11.167 | 2015-03-26 06:43:11.147 | TestPasswordChange
2015-03-26 06:43:45.542 | 2015-03-26 06:43:45.520 | test_password_change OK  34.37
2015-03-26 06:44:19.145 | 2015-03-26 06:44:19.122 | test_show_message_after_logout OK  33.60
2015-03-26 06:44:19.146 | 2015-03-26 06:44:19.123 | TestSaharaImageRegistry
2015-03-26 06:46:28.570 | 2015-03-26 06:46:28.544 | test_image_register_unregister FAIL 129.42
2015-03-26 06:46:28.572 | 2015-03-26 06:46:28.545 | TestSaharaJobBinary
2015-03-26 06:49:55.463 | 2015-03-26 06:49:55.432 | test_sahara_create_delete_job_binary_internaldb OK  206.89
2015-03-26 06:49:55.465 | 2015-03-26 06:49:55.434 | TestUser
2015-03-26 06:52:10.304 | 2015-03-26 06:52:10.273 | test_create_delete_user OK  134.84
2015-03-26 06:52:10.305 | 2015-03-26 06:52:10.274 | TestUserSettings
2015-03-26 06:54:36.371 | 2015-03-26 06:54:36.342 | test_user_settings_change OK  146.07
2015-03-26 06:54:36.372 | 2015-03-26 06:54:36.344 |
2015-03-26 06:54:36.374 | 2015-03-26 06:54:36.346 | ======================================================================
2015-03-26 06:54:36.376 | 2015-03-26 06:54:36.347 | FAIL: openstack_dashboard.test.integration_tests.tests.test_sahara_image_registry.TestSaharaImageRegistry.test_image_register_unregister
2015-03-26 06:54:36.378 | 2015-03-26 06:54:36.349 | ----------------------------------------------------------------------
2015-03-26 06:54:36.410 | 2015-03-26 06:54:36.351 | _StringException: Traceback (most recent call last):
2015-03-26 06:54:36.410 | 2015-03-26 06:54:36.352 | File "/opt/stack/new/horizon/openstack_dashboard/test/integration_tests/tests/test_sahara_image_registry.py", line 34, in test_image_register_unregister
2015-03-26 06:54:36.410 | 2015-03-26 06:54:36.354 | "Image was not registered.")
2015-03-26 06:54:36.410 | 2015-03-26 06:54:36.355 | File "/opt/stack/new/horizon/.tox/py27integration/local/lib/python2.7/site-packages/unittest2/case.py", line 678, in assertTrue
2015-03-26 06:54:36.411 | 2015-03-26 06:54:36.357 | raise self.failureException(msg)
2015-03-26 06:54:36.411 | 2015-03-26 06:54:36.359 | AssertionError: False is not true : Image was not registered.
2015-03-26 06:54:36.411 | 2015-03-26 06:54:36.361 |
2015-03-26 06:54:36.411 | 2015-03-26 06:54:36.362 | -------------------- >> begin captured logging << --------------------

Rob Cresswell (robcresswell-deactivatedaccount)
Changed in horizon:
status: New → Triaged
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to horizon (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/168124

Revision history for this message
David Lyle (david-lyle) wrote : Re: sahara integration tests failing blocking gate

If the whole integration test suite runs, this one job fails. If only this job runs, or a subset, it succeeds. Still examining.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on horizon (master)

Change abandoned by David Lyle (<email address hidden>) on branch: master
Review: https://review.openstack.org/168124
Reason: did not fix the issue

Revision history for this message
David Lyle (david-lyle) wrote : Re: sahara integration tests failing blocking gate

It is not job specific. The patch above skipped the offending job, and another unrelated job failed.

summary: - sahara integration tests failing blocking gate
+ integration tests failing blocking gate
Revision history for this message
David Lyle (david-lyle) wrote :

Temporary infra patch until we properly fix the issue: https://review.openstack.org/168180

Revision history for this message
Matt Riedemann (mriedem) wrote :

http://logstash.openstack.org/#eyJzZWFyY2giOiIobWVzc2FnZTpcIkZBSUw6IG9wZW5zdGFja19kYXNoYm9hcmQudGVzdC5pbnRlZ3JhdGlvbl90ZXN0cy50ZXN0cy50ZXN0X3NhaGFyYV9pbWFnZV9yZWdpc3RyeS5UZXN0U2FoYXJhSW1hZ2VSZWdpc3RyeS50ZXN0X2ltYWdlX3JlZ2lzdGVyX3VucmVnaXN0ZXJcIiBPUiBtZXNzYWdlOlwiRkFJTDogb3BlbnN0YWNrX2Rhc2hib2FyZC50ZXN0LmludGVncmF0aW9uX3Rlc3RzLnRlc3RzLnRlc3RfdXNlcl9jcmVhdGVfZGVsZXRlLlRlc3RVc2VyLnRlc3RfY3JlYXRlX2RlbGV0ZV91c2VyXCIpIEFORCB0YWdzOlwiY29uc29sZVwiIEFORCBidWlsZF9uYW1lOlwiZ2F0ZS1ob3Jpem9uLWRzdm0taW50ZWdyYXRpb25cIiBBTkQgYnVpbGRfcXVldWU6XCJnYXRlXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjYwNDgwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjE0Mjc2Nzc0MjYxMTYsIm1vZGUiOiIiLCJhbmFseXplX2ZpZWxkIjoiIn0=

David Lyle (david-lyle)
Changed in horizon:
status: Triaged → Confirmed
David Lyle (david-lyle)
Changed in horizon:
milestone: kilo-rc1 → liberty-1
Doug Hellmann (doug-hellmann)
Changed in horizon:
milestone: liberty-1 → liberty-2
Revision history for this message
Luigi Toscano (ltoscano) wrote :

The tests have been marked as non-voting, but after a while (~two months) they have been reenabled, but without solving the failures.
A review was proposed and merged to disable one of the failing tests (test_sahara_image_registry):

https://review.openstack.org/#/c/193438/

Unfortunately other tests started to fail, so another more specific bug was open with an linked review (this bug should have been referenced or used instead, sorry for that):
https://bugs.launchpad.net/horizon/+bug/1467950
https://review.openstack.org/#/c/194686/

The test disabled by review 193438 was reenabled with: https://review.openstack.org/#/c/193592/
Both last 2 patches have been backported to the stable/kilo branch as well.

Few tests still needs to be properly addressed, but this could be tracked by 1467950.

I propose either to close this bug or mark 1467950 as duplicated of this one (but it has few details linked), which would it be better?

Doug Hellmann (doug-hellmann)
Changed in horizon:
milestone: liberty-2 → liberty-3
Thierry Carrez (ttx)
Changed in horizon:
milestone: liberty-3 → liberty-rc1
Revision history for this message
Timur Sufiev (tsufiev-x) wrote :

David, it seems that we temporarily brushed away integration tests failures. Here is a list of related bps and bugs:

* https://blueprints.launchpad.net/horizon/+spec/integration-tests-hardening
* https://bugs.launchpad.net/horizon/+bug/1491309
* https://bugs.launchpad.net/horizon/+bug/1493205

David Lyle (david-lyle)
Changed in horizon:
status: Confirmed → Fix Committed
Thierry Carrez (ttx)
Changed in horizon:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in horizon:
milestone: liberty-rc1 → 8.0.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.