[HADOOP-8617] backport pure Java CRC32 calculator changes to branch-1

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: performance
• Hadoop Flags: Reviewed
• Assignee: Brandon Li
• Reporter: Brandon Li
• Created: 24/Jul/12 17:25
• Updated: 17/Oct/12 18:27
• Resolved: 25/Jul/12 14:02

Description

Multiple efforts have been made gradually to improve the CRC performance in Hadoop. This JIRA is to back port these changes to branch-1, which include HADOOP-6166, HADOOP-6148, HADOOP-7333.

The related HDFS and MAPREDUCE patches are uploaded to their original JIRAs HDFS-496 and MAPREDUCE-782.

Issue Links

• relates to: HADOOP-6148 Implement a pure Java CRC32 calculator
• relates to: HADOOP-6166 Improve PureJavaCrc32
• relates to: HADOOP-7333 Performance improvement in PureJavaCrc32
• relates to: HDFS-496 Use PureJavaCrc32 in HDFS
• relates to: MAPREDUCE-782 Use PureJavaCrc32 in mapreduce spills