Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10752

Add support for hardware crc on ARM aarch64 architecture

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Duplicate
    • Affects Version/s: trunk-win
    • Fix Version/s: None
    • Component/s: native, performance
    • Labels:
    • Environment:

      ARM aarch64 Juno development platform

      Description

      This patch adds support for hardware crc for ARM's new 64 bit architecture.

      The patch is completely conditionalized on _arch64_

      For the moment I have only done the non pipelined version as the hw I have only has 1 crc execute unit.

      Some initial benchmarks on terasort give

      sw crc: 107 sec
      hw crc: 103 sec

      The performance improvement is quite small, but this is limited by the fact that I am using early stage hw which is not performant.

      I have also built it on x86 and I think the change is fairly safe for other architectures because post conditionalization the src is identical on other architectures.

      This is the first patch I have submitted for Hadoop so I would welcome any feedback and help.

        Attachments

        1. jira-10752.patch
          2 kB
          Edward Nevill

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              enevill Edward Nevill
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified