[JCR-3730] Use object keys to create partitions in S3 automatically

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.4
• Fix Version/s: 2.7.5
• Component/s: jackrabbit-core
• Assignee: Dominique Pfister
• Reporter: Shashank Gupta
• Created: 20/Feb/14 10:17
• Updated: 17/Mar/14 13:55
• Resolved: 13/Mar/14 12:29

Description

To improve performance of S3, it is recommended to use object keys which enables to save data in multiple partitions. [1]
The current key format dataStore_SHA1_HASH put all data in single partition. It is recommended to remove dataStore_ prefix and split SHA1_HASH to enable randomness in prefix.
for e.g. if older key format is dataStore_004cb70c8f87d78f04da41e7547cb434094089ea. change this key format to 004c-b70c8f87d78f04da41e7547cb434094089ea
*Also consider upgrade scenario to migrate older key format data
http://docs.aws.amazon.com/AmazonS3/latest/dev/request-rate-perf-considerations.html