Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9601

Support native CRC on byte arrays

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: performance, util
    • Labels:
    • Target Version/s:
    • Release Note:
      Support NativeCrc32 verification for byte[] array backed buffers

      Description

      When we first implemented the Native CRC code, we only did so for direct byte buffers, because these correspond directly to native heap memory and thus make it easy to access via JNI. We'd generally assumed that accessing byte[] arrays from JNI was not efficient enough, but now that I know more about JNI I don't think that's true – we just need to make sure that the critical sections where we lock the buffers are short.

        Attachments

        1. HADOOP-9601-WIP-02.patch
          8 kB
          Gopal Vijayaraghavan
        2. HADOOP-9601-WIP-01.patch
          6 kB
          Gopal Vijayaraghavan
        3. HADOOP-9601-trunk-rebase-2.patch
          10 kB
          Gopal Vijayaraghavan
        4. HADOOP-9601-trunk-rebase.patch
          13 kB
          Gopal Vijayaraghavan
        5. HADOOP-9601-rebase+benchmark.patch
          13 kB
          Gopal Vijayaraghavan
        6. HADOOP-9601-bench.patch
          2 kB
          Gopal Vijayaraghavan

          Issue Links

            Activity

              People

              • Assignee:
                gopalv Gopal Vijayaraghavan
                Reporter:
                tlipcon Todd Lipcon
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: