[HADOOP-10846] DataChecksum#calculateChunkedSums not working for PPC when buffers not backed by array

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.4.1, 2.5.2
• Component/s: util
• Labels: BB2015-05-TBR

Environment

PowerPC platform

• Target Version/s: 2.8.3
• Assignee: Ayappan
• Reporter: Jinghui Wang
• Created: 16/Jul/14 01:31
• Updated: 11/Sep/17 06:25

Description

Got the following exception when running Hadoop on Power PC. The implementation for computing checksum when the data buffer and checksum buffer are not backed by arrays.

13/09/16 04:06:57 ERROR security.UserGroupInformation: PriviledgedActionException as:biadmin (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(java.io.IOException): org.apache.hadoop.fs.ChecksumException: Checksum error

Issue Links

• is duplicated by: HDFS-6903 Crc32 checksum errors in Big-Endian Architecture
• relates to: HADOOP-11665 Provide and unify cross platform byteorder support in native code