SRU: bionic: apply 50 ZFS upstream bugfixes

Bug #1764690 reported by Colin Ian King
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Fix Released
Medium
Colin Ian King
Bionic
Fix Released
Undecided
Unassigned
zfs-linux (Ubuntu)
Fix Released
Medium
Colin Ian King
Bionic
Invalid
Undecided
Unassigned

Bug Description

SRU Justification, bionic

Apply the first round of SRU bugfixes for ZFS from 0.7.5 onwards from upstream ZFS repository. This round fixes the following ZFS bugs:

    - OpenZFS 8373 - TXG_WAIT in ZIL commit path
      Closes zfsonlinux #6403
    - zfs promote|rename .../%recv should be an error
      Closes zfsonlinux #4843, #6339
    - Fix parsable 'zfs get' for compressratios
      Closes zfsonlinux #6436, #6449
    - Fix zpool events scripted mode tab separator
      Closes zfsonlinux #6444, #6445
    - zv_suspend_lock in zvol_open()/zvol_release()
      Closes zfsonlinux #6342
    - Allow longer SPA names in stats, allows bigger pool names
      Closes zfsonlinux #6481
    - vdev_mirror: load balancing fixes
      Closes zfsonlinux #6461
    - Fix zfs_ioc_pool_sync should not use fnvlist
      Closes zfsonlinux #6529
    - OpenZFS 8375 - Kernel memory leak in nvpair code
      Closes zfsonlinux #6578
    - OpenZFS 7261 - nvlist code should enforce name length limit
      Closes zfsonlinux #6579
    - OpenZFS 5778 - nvpair_type_is_array() does not recognize
      DATA_TYPE_INT8_ARRAY
      Closes zfsonlinux #6580
    - dmu_objset: release bonus buffer in failure path
      Closes zfsonlinux #6575
    - Fix false config_cache_write events
      Closes zfsonlinux #6617
    - Fix printk() calls missing log level
      Closes zfsonlinux #6672
    - Fix abdstats kstat on 32-bit systems
      Closes zfsonlinux #6721
    - Relax ASSERT for #6526
      Closes zfsonlinux #6526
    - Fix coverity defects: 147480, 147584 (Logically dead code)
      Closes zfsonlinux #6745
    - Fix coverity defects: CID 161388 (Resource Leak)
      Closes zfsonlinux #6755
    - Use ashift=12 by default on SSDSC2BW48 disks
      Closes zfsonlinux #6774
    - OpenZFS 8558, 8602 - lwp_create() returns EAGAIN
      Closes zfsonlinux #6779
    - ZFS send fails to dump objects larger than 128PiB
      Closes zfsonlinux #6760
    - Sort output of tunables in arc_summary.py
      Closes zfsonlinux #6828
    - Fix data on evict_skips in arc_summary.py
      Closes zfsonlinux #6882, #6883
    - Fix segfault in zpool iostat when adding VDEVs
      Closes zfsonlinux #6748, #6872
    - ZTS: Fix create-o_ashift test case
      Closes zfsonlinux #6924, #6877
    - Handle invalid options in arc_summary
      Closes zfsonlinux #6983
    - Call commit callbacks from the tail of the list
      Closes zfsonlinux #6986
    - Fix 'zpool add' handling of nested interior VDEVs
      Closes zfsonlinux #6678, #6996
    - Fix -fsanitize=address memory leak
      kmem_alloc(0, ...) in userspace returns a leakable pointer.
      Closes zfsonlinux #6941
    - Revert raidz_map and _col structure types
      Closes zfsonlinux #6981, #7023
    - Use zap_count instead of cached z_size for unlink
      Closes zfsonlinux #7019
    - OpenZFS 8897 - zpool online -e fails assertion when run on non-leaf
      vdevs
      Closes zfsonlinux #7030
    - OpenZFS 8898 - creating fs with checksum=skein on the boot pools
      fails ungracefully
      Closes zfsonlinux #7031
    - Emit an error message before MMP suspends pool
      Closes zfsonlinux #7048
    - OpenZFS 8641 - "zpool clear" and "zinject" don't work on "spare"
      or "replacing" vdevs
      Closes zfsonlinux #7060
    - OpenZFS 8835 - Speculative prefetch in ZFS not working for
      misaligned reads
      Closes zfsonlinux #7062
    - OpenZFS 8972 - zfs holds: In scripted mode, do not pad columns with
      spaces
      Closes zfsonlinux #7063
    - Revert "Remove wrong ASSERT in annotate_ecksum"
      Closes zfsonlinux #7079
    - OpenZFS 8731 - ASSERT3U(nui64s, <=, UINT16_MAX) fails for large
      blocks
      Closes zfsonlinux #7079
    - Prevent zdb(8) from occasionally hanging on I/O
      Closes zfsonlinux #6999
    - Fix 'zfs receive -o' when used with '-e|-d'
      Closes zfsonlinux #7088
    - Change movaps to movups in AES-NI code
      Closes zfsonlinux #7065, #7108
    - tx_waited -> tx_dirty_delayed in trace_dmu.h
      Closes zfsonlinux #7096
    - OpenZFS 8966 - Source file zfs_acl.c, function
      Closes zfsonlinux #7141
    - Fix zdb -c traverse stop on damaged objset root
      Closes zfsonlinux #7099
    - Fix zle_decompress out of bound access
      Closes zfsonlinux #7099
    - Fix racy assignment of zcb.zcb_haderrors
      Closes zfsonlinux #7099
    - Fix zdb -R decompression
      Closes zfsonlinux #7099, #4984
    - Fix zdb -E segfault
      Closes zfsonlinux #7099
    - Fix zdb -ed on objset for exported pool
      Closes zfsonlinux #7099, #6464

== Regression Potential ==
  These fixes, much like kernel SRU fixes touch a range of functionality of ZFS so there is chance of regressions. Testing will ensure core functionality works and there is minimized risk of lost of data and core functionality. The above fixes have passed the zfsonlinux ZFS regression tests and the majority of the the fixes cleanly apply and those that didn't required a small amount of wiggling rather than full back-ports, so I'm confident these have are faithful applications of upstream bug fixes.

== Testing ==
  Run ubuntu ZFS ADT regression tests in autotest-client-tests git repository. With the fixes, none of this should fail, hang or regress.

CVE References

Changed in zfs-linux (Ubuntu):
importance: Undecided → Medium
assignee: nobody → Colin Ian King (colin-king)
status: New → In Progress
description: updated
Changed in linux (Ubuntu):
importance: Undecided → Medium
assignee: nobody → Colin Ian King (colin-king)
status: New → In Progress
Revision history for this message
Launchpad Janitor (janitor) wrote :
Download full text (4.6 KiB)

This bug was fixed in the package zfs-linux - 0.7.5-1ubuntu15

---------------
zfs-linux (0.7.5-1ubuntu15) bionic; urgency=medium

  * Apply and/or backport upstream bugfixes (LP: #1764690)
    - OpenZFS 8373 - TXG_WAIT in ZIL commit path
      Closes zfsonlinux #6403
    - zfs promote|rename .../%recv should be an error
      Closes zfsonlinux #4843, #6339
    - Fix parsable 'zfs get' for compressratios
      Closes zfsonlinux #6436, #6449
    - Fix zpool events scripted mode tab separator
      Closes zfsonlinux #6444, #6445
    - zv_suspend_lock in zvol_open()/zvol_release()
      Closes zfsonlinux #6342
    - Allow longer SPA names in stats, allows bigger pool names
      Closes zfsonlinux #6481
    - vdev_mirror: load balancing fixes
      Closes zfsonlinux #6461
    - Fix zfs_ioc_pool_sync should not use fnvlist
      Closes zfsonlinux #6529
    - OpenZFS 8375 - Kernel memory leak in nvpair code
      Closes zfsonlinux #6578
    - OpenZFS 7261 - nvlist code should enforce name length limit
      Closes zfsonlinux #6579
    - OpenZFS 5778 - nvpair_type_is_array() does not recognize
      DATA_TYPE_INT8_ARRAY
      Closes zfsonlinux #6580
    - dmu_objset: release bonus buffer in failure path
      Closes zfsonlinux #6575
    - Fix false config_cache_write events
      Closes zfsonlinux #6617
    - Fix printk() calls missing log level
      Closes zfsonlinux #6672
    - Fix abdstats kstat on 32-bit systems
      Closes zfsonlinux #6721
    - Relax ASSERT for #6526
      Closes zfsonlinux #6526
    - Fix coverity defects: 147480, 147584 (Logically dead code)
      Closes zfsonlinux #6745
    - Fix coverity defects: CID 161388 (Resource Leak)
      Closes zfsonlinux #6755
    - Use ashift=12 by default on SSDSC2BW48 disks
      Closes zfsonlinux #6774
    - OpenZFS 8558, 8602 - lwp_create() returns EAGAIN
      Closes zfsonlinux #6779
    - ZFS send fails to dump objects larger than 128PiB
      Closes zfsonlinux #6760
    - Sort output of tunables in arc_summary.py
      Closes zfsonlinux #6828
    - Fix data on evict_skips in arc_summary.py
      Closes zfsonlinux #6882, #6883
    - Fix segfault in zpool iostat when adding VDEVs
      Closes zfsonlinux #6748, #6872
    - ZTS: Fix create-o_ashift test case
      Closes zfsonlinux #6924, #6877
    - Handle invalid options in arc_summary
      Closes zfsonlinux #6983
    - Call commit callbacks from the tail of the list
      Closes zfsonlinux #6986
    - Fix 'zpool add' handling of nested interior VDEVs
      Closes zfsonlinux #6678, #6996
    - Fix -fsanitize=address memory leak
      kmem_alloc(0, ...) in userspace returns a leakable pointer.
      Closes zfsonlinux #6941
    - Revert raidz_map and _col structure types
      Closes zfsonlinux #6981, #7023
    - Use zap_count instead of cached z_size for unlink
      Closes zfsonlinux #7019
    - OpenZFS 8897 - zpool online -e fails assertion when run on non-leaf
      vdevs
      Closes zfsonlinux #7030
    - OpenZFS 8898 - creating fs with checksum=skein on the boot pools
      fails ungracefully
      Closes zfsonlinux #7031
    - Emit an error message before MMP suspends pool
      Closes zfsonlinux #7048
    - OpenZFS 8641 - "zpool cl...

Read more...

Changed in zfs-linux (Ubuntu):
status: In Progress → Fix Released
Changed in zfs-linux (Ubuntu Bionic):
status: New → Invalid
Changed in linux (Ubuntu Bionic):
status: New → Fix Committed
Revision history for this message
Brad Figg (brad-figg) wrote :

This bug is awaiting verification that the kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-bionic' to 'verification-done-bionic'. If the problem still exists, change the tag 'verification-needed-bionic' to 'verification-failed-bionic'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

tags: added: verification-needed-bionic
Revision history for this message
Stefan Bader (smb) wrote :

Any progress on the verification for this?

Revision history for this message
Launchpad Janitor (janitor) wrote :
Download full text (11.4 KiB)

This bug was fixed in the package linux - 4.15.0-23.25

---------------
linux (4.15.0-23.25) bionic; urgency=medium

  * linux: 4.15.0-23.25 -proposed tracker (LP: #1772927)

  * arm64 SDEI support needs trampoline code for KPTI (LP: #1768630)
    - arm64: mmu: add the entry trampolines start/end section markers into
      sections.h
    - arm64: sdei: Add trampoline code for remapping the kernel

  * Some PCIe errors not surfaced through rasdaemon (LP: #1769730)
    - ACPI: APEI: handle PCIe AER errors in separate function
    - ACPI: APEI: call into AER handling regardless of severity

  * qla2xxx: Fix page fault at kmem_cache_alloc_node() (LP: #1770003)
    - scsi: qla2xxx: Fix session cleanup for N2N
    - scsi: qla2xxx: Remove unused argument from qlt_schedule_sess_for_deletion()
    - scsi: qla2xxx: Serialize session deletion by using work_lock
    - scsi: qla2xxx: Serialize session free in qlt_free_session_done
    - scsi: qla2xxx: Don't call dma_free_coherent with IRQ disabled.
    - scsi: qla2xxx: Fix warning in qla2x00_async_iocb_timeout()
    - scsi: qla2xxx: Prevent relogin trigger from sending too many commands
    - scsi: qla2xxx: Fix double free bug after firmware timeout
    - scsi: qla2xxx: Fixup locking for session deletion

  * Several hisi_sas bug fixes (LP: #1768974)
    - scsi: hisi_sas: dt-bindings: add an property of signal attenuation
    - scsi: hisi_sas: support the property of signal attenuation for v2 hw
    - scsi: hisi_sas: fix the issue of link rate inconsistency
    - scsi: hisi_sas: fix the issue of setting linkrate register
    - scsi: hisi_sas: increase timer expire of internal abort task
    - scsi: hisi_sas: remove unused variable hisi_sas_devices.running_req
    - scsi: hisi_sas: fix return value of hisi_sas_task_prep()
    - scsi: hisi_sas: Code cleanup and minor bug fixes

  * [bionic] machine stuck and bonding not working well when nvmet_rdma module
    is loaded (LP: #1764982)
    - nvmet-rdma: Don't flush system_wq by default during remove_one
    - nvme-rdma: Don't flush delete_wq by default during remove_one

  * Warnings/hang during error handling of SATA disks on SAS controller
    (LP: #1768971)
    - scsi: libsas: defer ata device eh commands to libata

  * Hotplugging a SATA disk into a SAS controller may cause crash (LP: #1768948)
    - ata: do not schedule hot plug if it is a sas host

  * ISST-LTE:pKVM:Ubuntu1804: rcu_sched self-detected stall on CPU follow by CPU
    ATTEMPT TO RE-ENTER FIRMWARE! (LP: #1767927)
    - powerpc/powernv: Handle unknown OPAL errors in opal_nvram_write()
    - powerpc/64s: return more carefully from sreset NMI
    - powerpc/64s: sreset panic if there is no debugger or crash dump handlers

  * fsnotify: Fix fsnotify_mark_connector race (LP: #1765564)
    - fsnotify: Fix fsnotify_mark_connector race

  * Hang on network interface removal in Xen virtual machine (LP: #1771620)
    - xen-netfront: Fix hang on device removal

  * HiSilicon HNS NIC names are truncated in /proc/interrupts (LP: #1765977)
    - net: hns: Avoid action name truncation

  * Ubuntu 18.04 kernel crashed while in degraded mode (LP: #1770849)
    - SAUCE: powerpc/perf: Fix memory allocation for...

Changed in linux (Ubuntu Bionic):
status: Fix Committed → Fix Released
Changed in linux (Ubuntu):
status: In Progress → Fix Released
Revision history for this message
Andy Whitcroft (apw) wrote :

This bug was erroneously marked for verification in bionic; verification is not required and verification-needed-bionic is being removed.

tags: added: kernel-fixup-verification-needed-bionic verification-done-bionic
removed: verification-needed-bionic
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.