[JCLOUDS-894] Expose component operations of multipart upload

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 2.0.0
• Component/s: jclouds-blobstore
• Labels: multipart
• Assignee: Andrew Gaul
• Reporter: Andrew Gaul
• Created: 25/Apr/15 18:16
• Updated: 13/Nov/15 20:16
• Resolved: 26/Aug/15 23:14

Description

Presently jclouds exposes multipart upload via a simple interface:

blobStore.putBlob(containerName, blob, new PutOptions().multipart(true));

This does not allow more complicated interactions such as parallel uploads, uploads with unknown content-lengths, and other interfaces like writing into an OutputStream. Further the current MultipartUploadStrategy implementations duplicate code across the azureblob, gcs, and s3 providers.

I propose to expose the MPU component operations, e.g., initiate, complete, abort, and upload part, via the BlobStore abstraction. This will allow us to address all the above features.

Issue Links

• is depended upon by: JCLOUDS-227 S3 blobstore driver: support for parallel multipart uploads
• relates to: JCLOUDS-760 Enable multipart upload in RegionScopedSwiftBlobStore
• relates to: JCLOUDS-944 Graduate GCS to core
• relates to: JCLOUDS-866 Investigate GCS multipart upload limits