[MAPREDUCE-4552] Encryption: Add support for PGP Encryption

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Do
• Component/s: security
• Assignee: Benoy Antony
• Reporter: Benoy Antony
• Created: 13/Aug/12 16:51
• Updated: 16/Oct/17 19:44
• Resolved: 16/Oct/17 19:44

Description

Provide support for PGP encryption by implementing Encrypter and Decrypter interfaces defined in MAPREDUCE-4450. This can be used by the cluster to protect the job secrets. This also be used map reduce jobs to encrypt/decrypt data.

Add PGPCodec as a CompressionCodec so that encrypted data can be processed transparently like compressed data . The aliases to the keys can be specified as part of Job.

Based on PGPCodec, a number of utilities are provided to encrypt, decrypt the data in cluster. They include

1. DistributedSplitter – Split an encrypted file into smaller files.
2. DistributedEncrypter – encrypt files in a cluster.
3. DistributedDecrypter – decrypt encrypted files in a cluster.
4. DistributedRecrypter – decrypt an encrypted file and encrypt it with another key.

Uitlities are added to encrypt/decrypt files in local file system

1. Genkey - Generate an asymmetric key pair (public and private keys) of a specified strength
2. Encrypt - Encrypt a file
3. Decrypt – Decrypt a file

Added as a contrib project - hadoop-crypto.