[HADOOP-10778] Use NativeCrc32 only if it is faster

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: util
• Labels: BB2015-05-TBR
• Assignee: Tsz-wo Sze
• Reporter: Tsz-wo Sze
• Created: 02/Jul/14 23:53
• Updated: 09/Jul/24 13:16
• Resolved: 09/Jul/24 13:16

Description

From the benchmark post in this comment, NativeCrc32 is slower than java.util.zip.CRC32 for Java 7 and above when bytesPerChecksum > 512.

Issue Links

• is related to: HADOOP-10865 Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases
• is related to: HADOOP-10838 Byte array native checksumming