[HADOOP-14680] Azure: IndexOutOfBoundsException in BlockBlobInputStream

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-beta1
• Component/s: fs/azure
• Target Version/s: 2.9.0, 3.0.0-beta1
• Release Note: Bug fix to Azure Filesystem related to HADOOP-14535
• Assignee: Thomas Marqardt
• Reporter: Rajesh Balamohan
• Created: 24/Jul/17 01:08
• Updated: 08/Aug/17 13:47
• Resolved: 08/Aug/17 13:47

Description

https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/BlockBlobInputStream.java#L361

On certain conditions, BlockBlobInputStream can throw IndexOutOfBoundsException. Following is an example

length:297898, offset:4194304, buf.len:4492202, writePos:4194304 :
In this case, MemoryOutputStream::capacity() would end up returning negative value and can cause IndexOutOfBoundsException

It should be return buffer.length - offset; to determine current capacity.

Issue Links

• is depended upon by: HADOOP-14535 wasb: implement high-performance random access and seek of block blobs
• is related to: HADOOP-14552 Über-jira: WASB client phase II: performance and testing