Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-782

Use PureJavaCrc32 in mapreduce spills

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.21.0, 1.1.0
    • performance
    • None
    • Reviewed

    Description

      HADOOP-6148 implemented a Pure Java implementation of CRC32 which performs better than the built-in one. This issue is to make use of it in the mapred package

      Attachments

        1. MAPREDUCE-782.branch-1.patch
          1 kB
          Brandon Li
        2. mapreduce-782.txt
          2 kB
          Todd Lipcon

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-8617 backport pure Java CRC32 calculator changes to branch-1

          • Major - Major loss of function.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-6148 Implement a pure Java CRC32 calculator

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: