[HDFS-8957] Consolidate client striping input stream codes for stateful read and positional read

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-alpha2
• Component/s: erasure-coding
• Assignee: Sammi Chen
• Reporter: Kai Zheng
• Created: 26/Aug/15 08:59
• Updated: 19/Jan/17 00:08

Description

Currently we have different implementations for client striping read, having both StatefulStripeReader and PositionStripeReader. I attempted to consolidate the two implementations into one, and it results in much simpler codes, and also better performance. Now in both read paths, it will:

• Use pooled ByteBuffers, as currently stateful read does;
• Read directly into application's buffer, as currently positional read does;
• Try to align and merge multiple stripes, as currently positional read does;
• Use ECChunk version decode API.

The resultant StripeReader is approaching very near now to the ideal state desired by next step, employing ErasureCoder API instead of RawErasureCoder API.

Will upload an initial patch to illustrate the rough change, even though it depends on other issues.

Issue Links

• depends upon: HDFS-8901 Use ByteBuffer in striping positional read
• incorporates: HDFS-10861 Refactor StripeReaders and use ECChunk version decode API
• is required by: HDFS-8907 Configurable striping read buffer threhold