Buffer IO Error in kernel logs on volume_delete

Bug #1075675 reported by John Griffith
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Cinder
Fix Released
High
John Griffith

Bug Description

dm_setup remove call in lvm delete_volume call in cinder/volume/driver.py seems to cause issues with the kernel on Precise. This also seems to coincide with a higher occurence of failures in the jenkins test runs for time-outs on volume delete (but that's a bit of a hypothesis currently).

Example entry in kern.log resulting from the remove call:
        Nov 6 17:18:15 devstack-1351804261 kernel: [417658.543584] connection1:0: detected conn error (1020)
        Nov 6 17:18:26 devstack-1351804261 kernel: [417669.627839] Buffer I/O error on device dm-0, logical block 262128

Changed in cinder:
importance: Undecided → High
assignee: nobody → John Griffith (john-griffith)
milestone: none → grizzly-1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/15518

Changed in cinder:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (master)

Reviewed: https://review.openstack.org/15518
Committed: http://github.com/openstack/cinder/commit/c5f3a32178c09f03d617998d7b6d0559ea9e0ca3
Submitter: Jenkins
Branch: master

commit c5f3a32178c09f03d617998d7b6d0559ea9e0ca3
Author: John Griffith <email address hidden>
Date: Tue Nov 6 11:08:58 2012 -0700

    Remove dm_setup(remove) call in volume_delete.

    While it makes sense to perform the dm_setup(remove) before
    performing the lvm remove, it seems to cause some buffer IO
    errors as evident by kern.log.

    I'm also a bit suspicous in that it seems the delete timeouts
    we see seems to have increased in frequency with this addition.
    I propose this step is removed until we completely understand the
    impact of the kernel error on Precise kernels.

    Fixes bug: #1075675

    Change-Id: I7ae4decea42d8f070d774d3e6376686b3e5b4f83

Changed in cinder:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in cinder:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in cinder:
milestone: grizzly-1 → 2013.1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.