[HBASE-14940] Make our unsafe based ops more safe

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0, 1.3.0, 1.0.3, 1.1.3, 0.98.17, 2.0.0
• Hadoop Flags: Reviewed
• Assignee: Anoop Sam John
• Reporter: Anoop Sam John
• Created: 07/Dec/15 12:21
• Updated: 20/Sep/16 15:26
• Resolved: 25/Dec/15 05:21

Description

Thanks for the nice findings Hiroshi Ikeda

This jira solves 3 issues with Unsafe operations and ByteBufferUtils
1. We can do sun unsafe based reads and writes iff unsafe package is available and underlying platform is having unaligned-access capability. But we were missing the second check
2. Java NIO is doing a chunk based copy while doing Unsafe copyMemory. The max chunk size is 1 MB. This is done for "A limit is imposed to allow for safepoint polling during a large copy" as mentioned in comments in Bits.java. We are also going to do same way
3. In ByteBufferUtils, when Unsafe is not available and ByteBuffers are off heap, we were doing byte by byte operation (read/copy). We can avoid this and do better way.

Issue Links

• is related to: HBASE-11425 Cell/DBB end-to-end on the read-path