[HDFS-3637] Add support for encrypting the DataTransferProtocol

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha
• Fix Version/s: 2.0.2-alpha
• Component/s: datanode, hdfs-client, security
• Target Version/s: 2.0.2-alpha
• Hadoop Flags: Reviewed
• Assignee: Aaron T. Myers
• Reporter: Aaron T. Myers
• Created: 11/Jul/12 16:36
• Updated: 05/Sep/14 23:13
• Resolved: 07/Aug/12 16:47

Description

Currently all HDFS RPCs performed by NNs/DNs/clients can be optionally encrypted. However, actual data read or written between DNs and clients (or DNs to DNs) is sent in the clear. When processing sensitive data on a shared cluster, confidentiality of the data read/written from/to HDFS may be desired.

Issue Links

• is related to: HDFS-5290 Port Encryption Support in DataTransfer protocol to Hadoop 1
• is related to: HDFS-2856 Fix block protocol so that Datanodes don't require root or jsvc
• is related to: HDFS-6606 Optimize HDFS Encrypted Transport performance
• relates to: MAPREDUCE-4417 add support for encrypted shuffle
• relates to: HDFS-5910 Enhance DataTransferProtocol to allow per-connection choice of encryption/plain-text