[JCLOUDS-769] Upload blob from stream

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.8.1
• Component/s: jclouds-blobstore
• Labels: multipart s3
• Assignee: Unassigned
• Reporter: Akos Hajnal
• Created: 05/Nov/14 11:57
• Updated: 05/Jan/18 08:06

Description

Dear Developers,
It was not easy, but using S3 API, it was possible to upload a large blob from stream - without knowing its size in advance (and storing all the data locally). I found solutions using jclouds' aws-s3 specific API (some async interface), but I really miss this feature from jclouds' general API.
My dream is to have a method like:
blob.getOutputStream() into which I can write as many data as I want,
which pushes data to the storage simultaneously until I close the stream.
(When I used S3, I created a wrapper class extending OutputStream, which initiates multipart upload, buffers data written to the output stream, writes a part when the buffer is full, and finalizes multipart upload on stream close.)
I don't know it is possible for all providers, but I really miss it...
Thank you,
Akos Hajnal

Issue Links

• is related to: JCLOUDS-627 Add support for aborting putBlob operations
• relates to: JCLOUDS-639 Provide methods to get the progress of a running upload to a blobstore