Description
CRC32C is another checksum very similar to our existing CRC32, but with a different polynomial. The chief advantage of this other polynomial is that SSE4.2 includes hardware support for its calculation. HDFS-2080 is the umbrella JIRA which proposes using this new polynomial to save substantial amounts of CPU.
Attachments
Attachments
Issue Links
- is blocked by
-
HADOOP-7444 Add Checksum API to verify and calculate checksums "in bulk"
- Closed
- is part of
-
HDFS-2080 Speed up DFS read path by lessening checksum overhead
- Closed
- relates to
-
HADOOP-13147 Constructors must not call overrideable methods
- Open