Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-7445

Implement bulk checksum verification using efficient native code

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.23.0
    • native, util
    • None
    • Reviewed

    Description

      Once HADOOP-7444 is implemented ("bulk" API for checksums), good performance gains can be had by implementing bulk checksum operations using JNI. This JIRA is to add checksum support to the native libraries. Of course if native libs are not available, it will still fall back to the pure-Java implementations.

      Attachments

        1. hadoop-7445.txt
          76 kB
          Todd Lipcon
        2. hadoop-7445.txt
          77 kB
          Todd Lipcon
        3. hadoop-7445.txt
          77 kB
          Todd Lipcon
        4. hadoop-7445.txt
          79 kB
          Todd Lipcon
        5. hadoop-7445.txt
          73 kB
          Todd Lipcon
        6. hadoop-7445.txt
          71 kB
          Todd Lipcon

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-7444 Add Checksum API to verify and calculate checksums "in bulk"

          • Major - Major loss of function.
          • Closed
          is part of

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-2080 Speed up DFS read path by lessening checksum overhead

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: