[HDFS-3637] Add support for encrypting the DataTransferProtocol

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha
• Fix Version/s: 2.0.2-alpha
• Component/s: datanode, hdfs-client, security
• Hadoop Flags: Reviewed
• Target Version/s: 2.0.2-alpha
• Assignee: Aaron T. Myers
• Reporter: Aaron T. Myers
• Created: 11/Jul/12 17:36
• Updated: 07/Feb/14 20:50
• Resolved: 07/Aug/12 17:47

Description

Currently all HDFS RPCs performed by NNs/DNs/clients can be optionally encrypted. However, actual data read or written between DNs and clients (or DNs to DNs) is sent in the clear. When processing sensitive data on a shared cluster, confidentiality of the data read/written from/to HDFS may be desired.

Issue Links

• is related to: HDFS-2856 Fix block protocol so that Datanodes don't require root or jsvc
• is related to: HDFS-5290 Port Encryption Support in DataTransfer protocol to Hadoop 1
• relates to: MAPREDUCE-4417 add support for encrypted shuffle
• relates to: HDFS-5910 Enhance DataTransferProtocol to allow per-connection choice of encryption/plain-text