[HDFS-15098] Add SM4 encryption method for HDFS

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: hdfs
• Labels: pull-request-available sm4
• Target Version/s: 3.4.0
• Hadoop Flags: Reviewed
• Release Note: New encryption codec "SM4/CTR/NoPadding" is added. Requires openssl version >=1.1.1 for native implementation.
• Tags: sm4
• Assignee: liusheng
• Reporter: liusheng
• Created: 08/Jan/20 01:45
• Updated: 27/Jan/24 03:28
• Resolved: 27/Sep/20 14:05

Description

SM4 (formerly SMS4)is a block cipher used in the Chinese National Standard for Wireless LAN WAPI (Wired Authentication and Privacy Infrastructure).
SM4 was a cipher proposed to for the IEEE 802.11i standard, but has so far been rejected by ISO. One of the reasons for the rejection has been opposition to the WAPI fast-track proposal by the IEEE. please see:

https://en.wikipedia.org/wiki/SM4_(cipher)

 

Use sm4 on hdfs as follows:
1.Configure Hadoop KMS
2.test HDFS sm4
hadoop key create key1 -cipher 'SM4/CTR/NoPadding'
hdfs dfs -mkdir /benchmarks
hdfs crypto -createZone -keyName key1 -path /benchmarks

requires:
1.openssl version >=1.1.1

Issue Links

• depends upon: HADOOP-16647 Support OpenSSL 1.1.1 LTS
• is duplicated by: HADOOP-16594 add sm4 crypto to hdfs
• relates to: HADOOP-17609 Make SM4 support optional for OpenSSL native code
• links to: GitHub Pull Request #2211