Hadoop Common
  1. Hadoop Common
  2. HADOOP-8617

backport pure Java CRC32 calculator changes to branch-1

        Details

        • Type: Bug Bug
        • Status: Closed
        • Priority: Major Major
        • Resolution: Fixed
        • Affects Version/s: None
        • Fix Version/s: 1.1.0
        • Component/s: performance
        • Labels:
          None
        • Hadoop Flags:
          Reviewed

          Description

          Multiple efforts have been made gradually to improve the CRC performance in Hadoop. This JIRA is to back port these changes to branch-1, which include HADOOP-6166, HADOOP-6148, HADOOP-7333.

          The related HDFS and MAPREDUCE patches are uploaded to their original JIRAs HDFS-496 and MAPREDUCE-782.

            Issue Links

            relates to

            Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6148 Implement a pure Java CRC32 calculator

            • Major - Major loss of function.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6166 Improve PureJavaCrc32

            • Major - Major loss of function.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. HADOOP-7333 Performance improvement in PureJavaCrc32

            • Minor - Minor loss of function, or other problem where easy workaround is present.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. HDFS-496 Use PureJavaCrc32 in HDFS

            • Minor - Minor loss of function, or other problem where easy workaround is present.
            • Closed

            Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-782 Use PureJavaCrc32 in mapreduce spills

            • Minor - Minor loss of function, or other problem where easy workaround is present.
            • Closed

              Activity

                People

                • Assignee:
                  Brandon Li
                  Reporter:
                  Brandon Li
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  7 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development