[JCLOUDS-866] Investigate GCS multipart upload limits

• Type: Task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.8.1
• Fix Version/s: 2.0.0
• Component/s: jclouds-blobstore, jclouds-labs-google
• Labels: google-cloud-storage
• Assignee: Andrew Gaul
• Reporter: Andrew Gaul
• Created: 27/Mar/15 18:14
• Updated: 13/Apr/22 07:05
• Resolved: 04/Jun/16 07:24

Description

GCS multipart upload composes several single-part uploads into a composite object. Google limits this to 32 object per compose call:

https://cloud.google.com/storage/docs/composite-objects

However MultipartUpload.MAX_NUMBER_OF_PARTS specifies 10,000 objects. We should investigate the correct upper limit.

broudy dalbani Would you like to look into this?

Issue Links

• blocks: JCLOUDS-944 Graduate GCS to core
• is related to: JCLOUDS-894 Expose component operations of multipart upload
• relates to: JCLOUDS-1606 Cannot upload more than 32 parts to GCS