[JCLOUDS-1369] MultipartUploadSlicingAlgorithm makes suboptimal choices with few part sizes

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.3
• Fix Version/s: 2.1.0
• Component/s: jclouds-blobstore
• Labels: google-cloud-storage
• Assignee: Andrew Gaul
• Reporter: Andrew Gaul
• Created: 04/Jan/18 23:32
• Updated: 09/Jan/18 20:59
• Resolved: 09/Jan/18 20:59

Description

When uploading a 3.2 GB blob to GCS I observed that MultipartUploadSlicingAlgorithm created (31) 32 MB parts and (1) 2.3 GB part. Instead it should create (32) 100 MB parts which will increase bandwidth utilization and improve retries.

Issue Links

• is related to: JCLOUDS-1368 GCS cannot upload multipart file larger than 1 GB