[AVRO-1371] Support of data encryption for Avro file

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.8.0
• Component/s: spec
• Labels: Rhino
• Assignee: Unassigned
• Reporter: Haifeng Chen
• Created: 04/Sep/13 02:51
• Updated: 30/Dec/18 05:31

Description

Avro file format is widely used in Hadoop. As data security is getting more and more attention in Hadoop community, we propose to improve Avro file format to be able to handle data encryption and decryption.

Similar to compression and decompression, encryption and decryption can be implemented with Codecs, a concept that already exists in Avro. However, Avro Codec context handling needs to be extended to support per-codec contexts, such as encryption keys, for encryption and decryption.

Avro supports multiple language implementations. This is an umbrella JIRA for this work and the implementation work for each language will be addressed in sub tasks.

Sub-Tasks

• Avro file data encryption for Java: Open