Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-19012

Use CRC tables to speed up galoisFieldMultiply in CrcUtil

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • util

    Description

      CrcUtil.galoisFieldMultiply(p, q, m) supports multiplying two polynomials p, q modulo any modulus polynomial m over GF(2). Since the method is used for CRC calculations, the modulus polynomial m is restricted to either the GZIP_POLYNOMIAL or the CASTAGNOLI_POLYNOMIAL. We may use CRC tables in PureJavaCrc32/PureJavaCrc32C to speed up the computation.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-13056 Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDDS-10489 Use CRC tables to speed up galoisFieldMultiply in CrcUtil

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-19035 CrcUtil/CrcComposer should not throw IOException for non-IO

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #6542

          Activity

            People

              szetszwo Tsz-wo Sze
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: