Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10778

Use NativeCrc32 only if it is faster

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • util

    Description

      From the benchmark post in this comment, NativeCrc32 is slower than java.util.zip.CRC32 for Java 7 and above when bytesPerChecksum > 512.

      Attachments

        1. c10778_20140717.patch
          19 kB
          Tsz-wo Sze
        2. c10778_20140702.patch
          20 kB
          Tsz-wo Sze

        Issue Links

        is related to

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-10865 Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-10838 Byte array native checksumming

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            szetszwo Tsz-wo Sze
            szetszwo Tsz-wo Sze
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment