[HAWQ-1193] TDE support in HAWQ

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: backlog
• Component/s: libhdfs
• Assignee: Hongxu Ma
• Reporter: Hongxu Ma
• Created: 06/Dec/16 09:08
• Updated: 25/Sep/17 09:10
• Resolved: 25/Sep/17 09:10

Description

TDE(transparently data encrypted) has been supported after hadoop 2.6:
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html
https://issues.apache.org/jira/browse/HDFS-6134

Use TDE can promise：
1, hdfs file is encrypted.
2, network transfer between hdfs and libhdfs client is encrypted.

So hawq will update libhdfs3 to support it.

Issue Links

• links to: GitHub Pull Request #1093

Sub-Tasks

• Add EncryptionZones related RPC: Closed
• Support TDE by adding a common class HttpClient to get response from KMS: Closed
• Support TDE by adding KmsClientProvider class to interact with KMS server.: Closed
• Support TDE write function.: Closed
• Support multi-append a file within encryption zone: Closed
• Fix travis broken: Reopened
• Support TDE read function: Closed
• Add TDE-related functionality into hawq command line tools: Closed
• Add TDE-related properties into hdfs-client.xml: Closed
• Add a UDF for showing whether the data directory is an encryption zone: Closed
• gpcheckhdfs should skip hdfs trash directory: Closed