shard range cache can get too big for memcache

Bug #1890643 reported by clayg
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Object Storage (swift)
Fix Committed
Undecided
Unassigned

Bug Description

The default max size for values in memcache is 1MB

https://cloud.google.com/memorystore/docs/memcached/memcached-configs

we've seen shard ranges responses larger than that on sharded dbs with >3K shard ranges

In my experiments when setting a value larger than 1MB using our memcache client no errors are reported, but the value is not cached which can overrun the root container db with GET requests to fetch the shard ranges.

we were able to work around the issue by increasing the max value in memcache

But larger values may not be ideal; we should consider documenting the recommended configuration tweak or breaking shard range caching into multiple keys (compression may be another option)

Revision history for this message
Alistair Coles (alistair-coles) wrote :
Changed in swift:
status: New → Fix Committed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.