Provider for Plainbox - Checkbox 0.21

Milestone information

Project:
Provider for Plainbox - Checkbox
Series:
trunk
Version:
0.21
Released:
2015-07-13  
Registrant:
Sylvain Pineau
Release registered:
2015-07-13
Active:
No. Drivers cannot target bugs and blueprints to this milestone.  

Download RDF metadata

Activities

Assigned to you:
No blueprints or bugs assigned to you.
Assignees:
1 Ara Pulido, 2 Daniel Manrique, 2 Pierre Equoy, 4 Po-Hsu Lin, 4 Sylvain Pineau
Blueprints:
No blueprints are targeted to this milestone.
Bugs:
13 Fix Released

Download files for this release

After you've downloaded a file, you can verify its authenticity using its MD5 sum or signature. (How do I verify a download?)

File Description Downloads
download icon 2013.com.canonical.certification.checkbox-0.21.tar.gz (md5, sig) release tarball 7
last downloaded 49 weeks ago
Total downloads: 7

Release notes 

Docking tests,
Thunderbolt tests,
New Graphic tests generators to run the same set of tests on both cards for
hybrid systems,
802.11ac detection improved
Wireless and networking tests fixed to use the new NetworkManager API on Vivid

Changelog 

View the full changelog

  * Added Dock jobs in Checkbox providers
  * providers:checkbox: Check misuse of the _REV iface in ACPI [DS]SDT
    tables Fixes https://bugs.launchpad.net/bugs/1456176
  * provider:checkbox: fix the graphic stress attachment job The
    graphic stress log attachment job was configured as a shell job,
    change it back to attachment to upload attachment correctly.
  * provider:checkbox: fix the Bluetooth A2DP test case, add it into
    test plans Fix the A2DP test case with pactl command and add it
    into the dev and 14.04 test plan.
  * provider:checkbox: add thunberbolt monitor generator Add the
    Thunderbolt monitor job generator for hybrid graphic systems.
  * provider:checkbox: remove the dependency of suspend-single-log-
    attach job Remove the suspend-advanced dependency from suspend-
    single-log-attach job, to avoid this job to be triggered and
    skipped in SRU testing.
  * provider:checkbox: fix I/O redirections for compiz and unity check
    tests This patch fixes the I/O redirection bug, change from 2&>1
    to 2>&1
  * provider:checkbox:jobs: fix missing jobs for hybrid graphic
    system, and the corresponding test plan Use local jobs to create
    those missing tests for hybrid graphic system, but use some normal
    jobs for 1st GPU instead of those generated by local jobs to solve
    dependency issue. Fixes: http://pad.lv/1425396,
    http://pad.lv/1431202
  * provider:checkbox: adding missing hybrid-graphic related jobs
  * resolution_before_suspend: adding switch_card job dependency to it
  * resolution_after_suspend: Adding dependency, it will depends on
    resolution_before_suspend
  * Dividing resolution tests into two-graphic-cards-specific jobs
  * xrandr_screens_after_suspend: the attachments have a prefix -
    xrandr_screens, card number should go after it
  * suspend.txt.in: adding cycle resolution test for hybrid graphic
    systems
  * provider:checkbox: run thunderbolt storage test as root This
    workaround is for bug http://pad.lv/1445419, just like how we did
    for eSATA and Firewire tests, otherwise it will fail due to unable
    to access other partitions.
  * provider:checkbox: change the esata/firewire remove job
    dependency. Make the esata/firewire remove job depends on the
    insert job, so that we could still test it even it failed with the
    storage test
  * providers:checkbox: add thunderbolt tests
  * Created new whitelist for certifying VMs on Hypervisors. Removed
    unnecessary ref to tickless_idle in server-functional whitelist
  * Removed FTP testing bits from network script as they are
    unreliable and no longer used
  * Modified Network Test to use a variable file size for standard
    iperf test. Cleaned up output to be less obnoxious. Modified
    ethernet/multi-nic for server use (as server is the only suite
    using ethernet/multi_nic). Modified the timeout because variable
    data sizes results in variable runtimes.
  * providers:checkbox: Add modinfo_attachment job. This adds a list
    of modinfo information for each loaded module. A "name" attribute
    is added to each block to identify the module. Tools which expect
    to parse straight-from-modinfo output may choke on this attribute.
    The job was also added to pertinent whitelists.
  * providers: Added modinfo_attachment to pertinent whitelists
  * providers:checkbox: Add modinfo_attachment job. This adds a list
    of modinfo information for each loaded module. A "name" attribute
    is added to each block to identify the module. Tools which expect
    to parse straight-from-modinfo output may choke on this attribute.
  * providers:checkbox: Add ssid_attachment job It attaches the PCI
    subsystem ID, this is to be collected for all systems though it
    has special significance to uniquely identify a specific
    configuration for some manufacturers only. Also adds this job to
    relevant whitelists.
  * providers:checkbox: Add lspci_standard_config_attachment job It
    attaches a dump of PCI standard configuration data for all devices
    in the system. This raw data is used to uniquely identify a
    specific configuration for some manufacturers only, and may have
    other uses in the future.
  * providers: Add lspci_standard_config_attachment job to pertinent
    whitelists
  * providers:resource: Updated package_resource to provide
    modaliases info If an installed packages has a Modaliases field in
    its Debian control data, it will be added as an attribute for the
    package: package: foo version: 1.0 modaliases: (mod mod mod)
  * providers:resource: Update package_resource to provide modaliases
    info If an installed package has a Modaliases field in its Debian
    control data, it will be added as an attribute for the package:
    package: foo version: 1.0 modaliases: (mod mod mod)
  * providers:checkbox: Added kernel_cmdline_attachment job. This
    shows the parameters used to boot the kernel and may contain
    information on global kernel parameters, quirks or tweaks used to
    enable a system.
  * providers: Added the kernel_cmdline_attachment to whitelists
  * providers:checkbox: Added kernel_cmdline_attachment job. This
    shows the parameters used to boot the kernel and may contain
    information on global kernel parameters, quirks or tweaks used to
    enable a system.
  * providers:checkbox: Minor fixes on sleep_time_test Fixes: LP#1445593
  * providers:checkbox:monitors.txt.in: Consider also the DP xrandr
    connectors to run the VGA test by initializing entries with not-
    supported status to explicit dump resource supported/not-supported
    status.
  * providers:checkbox: add recovery_info to provide image info
    recovery_info is a guacamole Command. use blkid to list partition
    information provide 1. Show recovery version. 2. Check recovery
    type. 3. Print out the file in recovery partition
  * providers:checkbox: add dkms_info_attachment,
    device_package_info_attachment jobs Collect device related package
    information, dkms_info_attachment: json dump format of dkms
    package information device_package_info_attachment: list packages
    with matched hardware modaliases information
  * providers:checkbox: add dkms_info to fetch device related package
    information. supported package types: - dkms (Dynamic Kernel
    Module Support): provides kernel modules - non-dkms: packages that
    with modaliases header and don't exist in dkms list - hardware
    modalias: might be a dkms or config package - oemalias: It is like
    non-dkms(w/o modalias) supported output format: - summary: one
    line per packages with matched modaliases information - json: json
    output (fully information)
  * providers:checkbox:graphics.txt.in: Escape subshell commands in
    maximum_resolution generator Not escaping the subshell commands
    hardcoded the current and maximum resolutions values in the new
    job definition thus preventing any dynamic change to be detected.
    Also replacing the xdpyinfo command by a call to
    gdk_screen_get_monitor_geometry() using the python gi.repository
    allow us to only get the primary display resolution (useful in a
    dual head setup).
    https://developer.gnome.org/gdk3/stable/GdkScreen.html#gdk-screen-
    get-monitor-geometry Fixes: https://bugs.launchpad.net/plainbox-
    provider-checkbox/+bug/1447466
  * providers:resource:src: Add some heuristic to guess 802.11ac
    capabilities Broadcom drivers don't work well with libnl and
    802.11ac capabilities are not reported by the resource job. But
    the name of the device tells us that ac is supported (using the
    lspci output), e.g: 802.11ac Wireless Network Adapter [14e4:43b1]
    (rev 03) Using the "802.11ac" pattern the resource script can now
    report capabilities for broken drivers but with a meaningful name.
  * providers:resource:src: Store 802.11ac capabilities in a dedicated
    bitfield Since the print_phy_handler callback is run several
    times, capabilities are now provided as an extra arg to
    nl_cb_set(). The wireless_capabilities being defined in main().
  * provider:checkbox: gzip the
    firmware/fwts_desktop_diagnosis_results.log attachment This job
    produces a huge attachment. In a real-world submission it resulted
    in a 5MB xml file (usually submissions are around 1MB). Of this,
    4.3 MB were from this attachment. With gzip, the attachment was
    reduced to about 400KB so it's much more manageable (though still
    quite big). Fixes: https://bugs.launchpad.net/plainbox-provider-
    checkbox/+bug/1460095
  * providers:checkbox:bin:create_connection: Reload all connection
    files from disk NetworkManager does not monitor changes to
    connection files by default. So we need to use this command in
    order to tell NetworkManager to re-read the connection profiles
    from disk when a change was made to them.
  * providers:checkbox:bin:wifi_time2reconnect: Fix nmcli calls to
    comply with NM >= 0.9.10
  * providers:checkbox:bin:network_wait: Fix nmcli calls to comply
    with NM >= 0.9.10
  * providers:checkbox:bin:connect_wireless: Fix nmcli calls to comply
    with NM >= 0.9.10
  * providers:checkbox:bin:create_connection: Fix nmcli calls to
    comply with NM >= 0.9.10
  * providers:checkbox:jobs:mobilebroadband: Fix shell commands to
    comply with NM >= 0.9.10
  * providers:checkbox:jobs:wireless: Fix shell commands to comply
    with NM >= 0.9.10
  * providers:checkbox:jobs:suspend: Fix shell commands to comply with
    NM >= 0.9.10

0 blueprints and 13 bugs targeted

Bug report Importance Assignee Status
1455197 #1455197 jobs using dkms_info script use it incorrectly, tests fail to run 2 Critical Daniel Manrique  10 Fix Released
1457505 #1457505 jobs using recovery_info use it incorrectly 2 Critical Daniel Manrique  10 Fix Released
1459543 #1459543 nmcli parameters changed as of 15.04 2 Critical Sylvain Pineau  10 Fix Released
1464195 #1464195 Need a job for double clicking 2 Critical Pierre Equoy  10 Fix Released
1450386 #1450386 Add docking tests 3 High Pierre Equoy  10 Fix Released
1460095 #1460095 Please gzip the firmware/fwts_desktop_diagnosis_results.log attachment 3 High Sylvain Pineau  10 Fix Released
1460556 #1460556 audio_settings script would fail on Vivid 3 High Sylvain Pineau  10 Fix Released
1465104 #1465104 The graphics-stress-results.tar.gz from stress/graphics-tarball didn't get uploaded to C3 3 High Po-Hsu Lin  10 Fix Released
1326746 #1326746 Bluetooth A2DP test is not in our whitelist yet, and its command needs to be fine-tuned 4 Medium Po-Hsu Lin  10 Fix Released
1444407 #1444407 monitor audio testing could be tested along with monitor tests 5 Low Po-Hsu Lin  10 Fix Released
1448020 #1448020 compiz check will generate a leftover file called 1 5 Low Po-Hsu Lin  10 Fix Released
1463237 #1463237 Wireless tests would fail on vivid 1 Undecided Sylvain Pineau  10 Fix Released
1470758 #1470758 Wireless AC after suspend tests (auto only) fail if the system does not support AC 1 Undecided Ara Pulido  10 Fix Released
This milestone contains Public information
Everyone can see this information.