Comment 8 for bug 1075080

On 11/09/2012 01:54 AM, mlchen wrote:
> with the checkbox version(0.14.10+bzr1816+201211081703~precise1), test
> results are as follows:
>
> cid: 201202-10550
> https://certification.canonical.com/hardware/201202-10550/submission/b5ogMDmc3Jtjvc1/result/test:power-management%252Fsuspend_30_cycles:certification
>
> ==================== Test Results ====================
> - Cycle 0: Status: FAIL Sleep Elapsed: 1.39373 Resume Elapsed: 3.40977
> - Cycle 1: Status: FAIL Sleep Elapsed: 1.08923 Resume Elapsed: 5.03615
> - Cycle 2: Status: FAIL Sleep Elapsed: 1.12323 Resume Elapsed: 3.02944
> - Cycle 3: Status: FAIL Sleep Elapsed: 1.03981 Resume Elapsed: 3.09665
> - Cycle 4: Status: PASS Sleep Elapsed: 1.14332 Resume Elapsed: 2.82966
> - Cycle 5: Status: FAIL Sleep Elapsed: 1.18955 Resume Elapsed: 3.01554
> - Cycle 6: Status: PASS Sleep Elapsed: 1.06171 Resume Elapsed: 2.90388
> - Cycle 7: Status: PASS Sleep Elapsed: 1.17864 Resume Elapsed: 2.99029
> - Cycle 8: Status: FAIL Sleep Elapsed: 1.06906 Resume Elapsed: 3.40321
> - Cycle 9: Status: FAIL Sleep Elapsed: 1.11843 Resume Elapsed: 3.00908
> - Cycle 10: Status: FAIL Sleep Elapsed: 1.47195 Resume Elapsed: 3.47936
> - Cycle 11: Status: FAIL Sleep Elapsed: 1.03509 Resume Elapsed: 3.59540
> - Cycle 12: Status: FAIL Sleep Elapsed: 1.03022 Resume Elapsed: 4.98760
> - Cycle 13: Status: FAIL Sleep Elapsed: 1.11767 Resume Elapsed: 3.41409
> - Cycle 14: Status: FAIL Sleep Elapsed: 1.03037 Resume Elapsed: 3.49904
> - Cycle 15: Status: FAIL Sleep Elapsed: 1.05137 Resume Elapsed: 3.02657
> - Cycle 16: Status: PASS Sleep Elapsed: 1.32039 Resume Elapsed: 2.97371
> - Cycle 17: Status: PASS Sleep Elapsed: 1.12571 Resume Elapsed: 2.97739
> - Cycle 18: Status: FAIL Sleep Elapsed: 1.15154 Resume Elapsed: 5.02414
> - Cycle 19: Status: FAIL Sleep Elapsed: 1.18305 Resume Elapsed: 5.00862
> - Cycle 20: Status: FAIL Sleep Elapsed: 1.15380 Resume Elapsed: 3.45686
> - Cycle 21: Status: FAIL Sleep Elapsed: 1.12337 Resume Elapsed: 3.47833
> - Cycle 22: Status: FAIL Sleep Elapsed: 1.06649 Resume Elapsed: 3.00764
> - Cycle 23: Status: FAIL Sleep Elapsed: 1.25340 Resume Elapsed: 3.52607
> - Cycle 24: Status: FAIL Sleep Elapsed: 1.20590 Resume Elapsed: 3.51873
> - Cycle 25: Status: FAIL Sleep Elapsed: 1.18530 Resume Elapsed: 3.02096
> - Cycle 26: Status: FAIL Sleep Elapsed: 1.03955 Resume Elapsed: 3.42191
> - Cycle 27: Status: FAIL Sleep Elapsed: 1.13279 Resume Elapsed: 5.07549
> - Cycle 28: Status: FAIL Sleep Elapsed: 1.14744 Resume Elapsed: 4.48748
> - Cycle 29: Status: PASS Sleep Elapsed: 1.18249 Resume Elapsed: 2.95561
> Average time to sleep: 1.14715
> Average time to resume: 3.55529
> High Failures: 1
> - sleep
>
> cid: 201202-10549
> https://certification.canonical.com/hardware/201202-10549/submission/YoXQ0igI1DO5jMU/result/test:power-management%252Fsuspend_30_cycles:certification
>
> ==================== Test Results ====================
> - Cycle 0: Status: FAIL Sleep Elapsed: 1.41007 Resume Elapsed: 4.00166
> - Cycle 1: Status: PASS Sleep Elapsed: 1.42494 Resume Elapsed: 2.70043
> - Cycle 2: Status: PASS Sleep Elapsed: 1.46398 Resume Elapsed: 2.72322
> - Cycle 3: Status: PASS Sleep Elapsed: 1.41251 Resume Elapsed: 2.72894
> - Cycle 4: Status: PASS Sleep Elapsed: 1.39551 Resume Elapsed: 2.74995
> - Cycle 5: Status: FAIL Sleep Elapsed: 1.41060 Resume Elapsed: 4.75260
> - Cycle 6: Status: PASS Sleep Elapsed: 1.37369 Resume Elapsed: 2.77151
> - Cycle 7: Status: FAIL Sleep Elapsed: 1.51405 Resume Elapsed: 4.85399
> - Cycle 8: Status: PASS Sleep Elapsed: 1.43015 Resume Elapsed: 2.74724
> - Cycle 9: Status: PASS Sleep Elapsed: 1.40118 Resume Elapsed: 2.71682
> - Cycle 10: Status: FAIL Sleep Elapsed: 1.55961 Resume Elapsed: 4.73419
> - Cycle 11: Status: FAIL Sleep Elapsed: 1.46943 Resume Elapsed: 4.64328
> - Cycle 12: Status: FAIL Sleep Elapsed: 1.33397 Resume Elapsed: 4.76512
> - Cycle 13: Status: PASS Sleep Elapsed: 1.41838 Resume Elapsed: 2.67348
> - Cycle 14: Status: FAIL Sleep Elapsed: 1.47049 Resume Elapsed: 3.12740
> - Cycle 15: Status: PASS Sleep Elapsed: 1.54578 Resume Elapsed: 2.68489
> - Cycle 16: Status: PASS Sleep Elapsed: 1.46668 Resume Elapsed: 2.75512
> - Cycle 17: Status: PASS Sleep Elapsed: 1.47240 Resume Elapsed: 2.73121
> - Cycle 18: Status: PASS Sleep Elapsed: 1.37224 Resume Elapsed: 2.68063
> - Cycle 19: Status: PASS Sleep Elapsed: 1.37872 Resume Elapsed: 2.66516
> - Cycle 20: Status: PASS Sleep Elapsed: 1.43891 Resume Elapsed: 2.83370
> - Cycle 21: Status: FAIL Sleep Elapsed: 1.39099 Resume Elapsed: 4.66152
> - Cycle 22: Status: PASS Sleep Elapsed: 1.37565 Resume Elapsed: 2.81365
> - Cycle 23: Status: PASS Sleep Elapsed: 1.41427 Resume Elapsed: 2.69592
> - Cycle 24: Status: FAIL Sleep Elapsed: 1.40196 Resume Elapsed: 4.64976
> - Cycle 25: Status: FAIL Sleep Elapsed: 1.37113 Resume Elapsed: 4.85894
> - Cycle 26: Status: FAIL Sleep Elapsed: 1.41766 Resume Elapsed: 4.15128
> - Cycle 27: Status: FAIL Sleep Elapsed: 1.42772 Resume Elapsed: 4.75961
> - Cycle 28: Status: FAIL Sleep Elapsed: 1.49251 Resume Elapsed: 4.16125
> - Cycle 29: Status: PASS Sleep Elapsed: 1.65689 Resume Elapsed: 2.77556
> Average time to sleep: 1.43707
> Average time to resume: 3.48560
> High Failures: 1
> - sleep
>

That looks good, this has also changed a bit. the sleep tests were just
finally merged in on Friday to change the behaviour so that the sleep
tests themselves no longer fail when it take too long to wake up or go
to sleep. That's now handled by a new job.

There's a pending cert merge that will add the new time-check jobs to
the whitelists. Once that is done, and both have been pushed to the
PPA, the failure on sleep time should go away.

--
Jeff Lane - Hardware Certification Engineer and Test Tools Developer
Ubuntu Ham: W4KDH
Freenode IRC: bladernr or bladernr_
gpg: 1024D/3A14B2DD 8C88 B076 0DD7 B404 1417 C466 4ABD 3635 3A14 B2DD