[HDFS-8668] Erasure Coding: revisit buffer used for encoding and decoding.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha1
• Hadoop Flags: Reviewed
• Assignee: Sammi Chen Assign to me
• Reporter: Yi Liu
• Created: 25/Jun/15 13:57
• Updated: 12/Aug/16 06:52
• Resolved: 12/Aug/16 05:58

Description

For encoding and decoding buffers, currently some places use java heap ByteBuffer, some use direct byteBUffer, and some use java byte array. If the coder implementation is native, we should use direct ByteBuffer. This jira is to revisit all encoding/decoding buffers and improve them.

Issue Links

• contains: HDFS-8901 Use ByteBuffer in striping positional read
• contains: HDFS-8902 Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)
• contains: HDFS-8903 Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping write
• contains: HDFS-8904 Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping recovery on DataNode side
• contains: HDFS-10718 Prefer direct ByteBuffer in native RS encoder and decoder