Make the hardcoded 1 segment per second download rate a conf option

Bug #786197 reported by gholt
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Object Storage (swift)
Fix Released
Low
Unassigned

Bug Description

Make the hardcoded 1 segment per second download rate a conf option. One idea is to have two different rates, one for the usual GET and one for COPY. It might be desirable to encourage the end user to COPY a highly segmented object into a whole object for better performance.

Current hardcoded limit is 1 segment per second to limit an end user turning 1 request into many more very quickly, flooding the cluster. 1 segment per second allows 100M segmented objects to be downloaded at 1Gbit rates. If it was changed to say, 100 segments per second, that would allow 1M segmented objects to be downloaded at 1Gbit rates. But a single user request per second would turn into 100 backend requests per second, so caution!

Changed in swift:
status: New → Confirmed
importance: Undecided → Low
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to swift (master)

Fix proposed to branch: master
Review: https://review.openstack.org/8300

Changed in swift:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to swift (master)

Reviewed: https://review.openstack.org/8300
Committed: http://github.com/openstack/swift/commit/6987d222de0c39137dcbaf4c1577862963cd75e3
Submitter: Jenkins
Branch: master

commit 6987d222de0c39137dcbaf4c1577862963cd75e3
Author: Greg Lange <email address hidden>
Date: Thu Jun 7 20:19:31 2012 +0000

    Added config options for rate limiting of large object downloads.

    bug 786197

    Change-Id: Idd73986ca4550b20dff340df4acd12f3bfc01075

Changed in swift:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in swift:
milestone: none → 1.6.0
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.