[HADOOP-14081] S3A: Consider avoiding array copy in S3ABlockOutputStream (ByteArrayBlock)

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.8.0, 3.0.0-alpha4
• Component/s: fs/s3
• Assignee: Rajesh Balamohan
• Reporter: Rajesh Balamohan
• Created: 14/Feb/17 09:32
• Updated: 21/Apr/17 21:49
• Resolved: 20/Feb/17 16:24

Description

In S3ADataBlocks::ByteArrayBlock, data is copied whenever startUpload is called. It might be possible to directly access the byte[] array from ByteArrayOutputStream.

Might have to extend ByteArrayOutputStream and create a method like getInputStream() which can return ByteArrayInputStream. This would avoid expensive array copy during large upload.

Issue Links

• relates to: HADOOP-14028 S3A BlockOutputStreams doesn't delete temporary files in multipart uploads or handle part upload failures