Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15098

Add SM4 encryption method for HDFS

    XMLWordPrintableJSON

Details

    • Reviewed
    • New encryption codec "SM4/CTR/NoPadding" is added. Requires openssl version >=1.1.1 for native implementation.
    • sm4

    Description

      SM4 (formerly SMS4)is a block cipher used in the Chinese National Standard for Wireless LAN WAPI (Wired Authentication and Privacy Infrastructure).
      SM4 was a cipher proposed to for the IEEE 802.11i standard, but has so far been rejected by ISO. One of the reasons for the rejection has been opposition to the WAPI fast-track proposal by the IEEE. please see:

      https://en.wikipedia.org/wiki/SM4_(cipher)

       

      Use sm4 on hdfs as follows:
      1.Configure Hadoop KMS
      2.test HDFS sm4
      hadoop key create key1 -cipher 'SM4/CTR/NoPadding'
      hdfs dfs -mkdir /benchmarks
      hdfs crypto -createZone -keyName key1 -path /benchmarks

      requires:
      1.openssl version >=1.1.1

      Attachments

        1. HDFS-15098.009.patch
          83 kB
          liusheng
        2. image-2020-08-19-16-54-41-341.png
          17 kB
          liusheng
        3. HDFS-15098.008.patch
          63 kB
          zZtai
        4. HDFS-15098.007.patch
          57 kB
          liusheng
        5. HDFS-15098.006.patch
          56 kB
          zZtai
        6. HDFS-15098.005.patch
          56 kB
          zZtai
        7. HDFS-15098.004.patch
          50 kB
          zZtai
        8. HDFS-15098.003.patch
          46 kB
          zZtai
        9. HDFS-15098.002.patch
          30 kB
          zZtai
        10. HDFS-15098.001.patch
          28 kB
          liusheng

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HBASE-28714 Hadoop check for hadoop 3.4.0 is failing

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          causes

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-19152 Do not hard code security providers.

          • Major - Major loss of function.
          • Resolved
          depends upon

          Task - A task that needs to be done. HADOOP-16647 Support OpenSSL 1.1.1 LTS

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-16594 add sm4 crypto to hdfs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-17609 Make SM4 support optional for OpenSSL native code

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #2211

          Activity

            People

              seanlau liusheng
              seanlau liusheng
              Votes:
              1 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m