Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15033

Use java.util.zip.CRC32C for Java 9 and above

    XMLWordPrintableJSON

Details

    Description

      java.util.zip.CRC32C implementation is available since Java 9.
      https://docs.oracle.com/javase/9/docs/api/java/util/zip/CRC32C.html
      Platform specific assembler intrinsics make it more effective than any pure Java implementation.

      Hadoop is compiled against Java 8 but class constructor may be accessible with method handle on 9 to instances implementing Checksum in runtime.

      Attachments

        1. HADOOP-15033.001.patch
          6 kB
          Dmitry Chuyko
        2. HADOOP-15033.001.patch
          6 kB
          Dmitry Chuyko
        3. HADOOP-15033.002.patch
          8 kB
          Dmitry Chuyko
        4. HADOOP-15033.003.patch
          10 kB
          Dmitry Chuyko
        5. HADOOP-15033.003.patch
          10 kB
          Dmitry Chuyko
        6. HADOOP-15033.004.patch
          11 kB
          Dmitry Chuyko
        7. HADOOP-15033.005.diff
          6 kB
          Dmitry Chuyko
        8. HADOOP-15033.005.diff
          6 kB
          Dmitry Chuyko
        9. HADOOP-15033.005.diff
          6 kB
          Dmitry Chuyko
        10. HADOOP-15033.005.patch
          34 kB
          Dmitry Chuyko
        11. HADOOP-15033.006.patch
          6 kB
          Dmitry Chuyko
        12. HADOOP-15033.007.patch
          19 kB
          Dmitry Chuyko
        13. HADOOP-15033.007.patch
          19 kB
          Dmitry Chuyko
        14. HADOOP-15033.008.patch
          19 kB
          Dmitry Chuyko
        15. HADOOP-15033.009.patch
          21 kB
          Dmitry Chuyko
        16. HADOOP-15033.009.patch
          21 kB
          Dmitry Chuyko
        17. HADOOP-15033.009.patch
          21 kB
          Dmitry Chuyko
        18. HADOOP-15033.009.patch
          21 kB
          Dmitry Chuyko
        19. HADOOP-15033.009.patch
          21 kB
          Dmitry Chuyko
        20. HADOOP-15033.009.patch
          21 kB
          Dmitry Chuyko
        21. HADOOP-15033.009.patch
          21 kB
          Dmitry Chuyko
        22. HADOOP-15033.010.patch
          25 kB
          Dmitry Chuyko

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-11660 Add support for hardware crc of HDFS checksums on ARM aarch64 architecture

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-10674 Rewrite the PureJavaCrc32 loop for performance improvement

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. HADOOP-11123 Fix Java 9 incompatibilies in Hadoop

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-16360 CRC32 is inefficient on x86

          • Normal -
          • Patch Available
          links to

          Web Link GitHub Pull Request #291

          Activity

            People

              dchuyko Dmitry Chuyko
              dchuyko Dmitry Chuyko
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: