Mitigate periodic task scheduler stampedes

Bug #962665 reported by Rick Harris
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Medium
Rick Harris

Bug Description

When the compute workers are restarted, they all end up running their scheduler tasks at the same time causing problems for external services.

To mitigate this stampeding behavior, we can introduce a random initial delay fuzz controllable via a FLAG.

Changed in nova:
assignee: nobody → Rick Harris (rconradharris)
importance: Undecided → Medium
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (master)

Fix proposed to branch: master
Review: https://review.openstack.org/5719

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/5719
Committed: http://github.com/openstack/nova/commit/8b3f327df03d2ca530d094342710ff3f75ae3934
Submitter: Jenkins
Branch: master

commit 8b3f327df03d2ca530d094342710ff3f75ae3934
Author: Rick Harris <email address hidden>
Date: Thu Mar 22 23:50:36 2012 +0000

    Add periodic_fuzzy_delay option.

    Fixes bug 962665

    This random delay is intended to reduce the stampeding behavior
    associated with periodic tasks when compute workers are restarted in
    unison across a cluster.

    Change-Id: Ie3771d94af29049061c129b8ea562ee447a61771

Changed in nova:
status: In Progress → Fix Committed
Devin Carlen (devcamcar)
Changed in nova:
milestone: none → folsom-1
Thierry Carrez (ttx)
Changed in nova:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in nova:
milestone: folsom-1 → 2012.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.