ctest/"make test" reports 100% tests pass even when some fail.
Bug #1472911 reported by
Daniel van Vugt
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Mir |
Fix Released
|
High
|
Daniel van Vugt | ||
mir (Ubuntu) |
Fix Released
|
Medium
|
Unassigned |
Bug Description
ctest or "make test" reports 100% PASS even with failing tests!
For example:
1. Break a test by setting an invalid expectation like in MirPixelFormatU
2. Rebuild
3. $ make test
100% tests passed, 0 tests failed out of 9
4. $ ctest
100% tests passed, 0 tests failed out of 9
5. $ umockdev-run -- mir_unit_tests
[ FAILED ] 1 test, listed below:
[ FAILED ] MirPixelFormatU
Related branches
lp:~vanvugt/mir/fix-1472911
- PS Jenkins bot (community): Approve (continuous-integration)
- Kevin DuBois (community): Approve
- Alexandros Frantzis (community): Approve
-
Diff: 10 lines (+1/-1)1 file modifiedtests/mir_test_framework/main.cpp (+1/-1)
summary: |
- "make test" reports 100% PASS even with failing tests! + "make test" reports 100% tests pass even when some fail. |
summary: |
- "make test" reports 100% tests pass even when some fail. + ctest/"make test" reports 100% tests pass even when some fail. |
description: | updated |
description: | updated |
Changed in mir: | |
assignee: | nobody → Daniel van Vugt (vanvugt) |
milestone: | none → 0.15.0 |
status: | New → In Progress |
Changed in mir (Ubuntu): | |
importance: | Undecided → Medium |
status: | New → Triaged |
Changed in mir: | |
status: | Fix Committed → Fix Released |
To post a comment you must log in.
Fix committed into lp:mir at revision None, scheduled for release in mir, milestone 0.15.0