-
Type:
Sub-task
-
Status: Resolved
-
Priority:
Minor
-
Resolution: Fixed
-
Affects Version/s: None
-
Fix Version/s: 2.8.0, 3.0.0-alpha4
-
Component/s: fs/s3
-
Labels:None
In S3ADataBlocks::ByteArrayBlock, data is copied whenever startUpload is called. It might be possible to directly access the byte[] array from ByteArrayOutputStream.
Might have to extend ByteArrayOutputStream and create a method like getInputStream() which can return ByteArrayInputStream. This would avoid expensive array copy during large upload.
- relates to
-
HADOOP-14028 S3A BlockOutputStreams doesn't delete temporary files in multipart uploads or handle part upload failures
-
- Resolved
-