[HIVE-9974] Sensitive data redaction: data appears in name of mapreduce job

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.3.0, 2.0.0
• Assignee: Sergio Peña
• Reporter: Sergio Peña
• Created: 16/Mar/15 14:18
• Updated: 16/Feb/16 23:53
• Resolved: 18/May/15 18:07

Description

Set up a cluster, configured a redaction rule to redact "B0096EZHM2", and ran Hive queries on the cluster.

Looking at the YARN RM web UI and Job History Server web UI, I see that the mapreduce jobs spawned by the Hive queries have the sensitive data ("B0096EZHM2") showing in the job names:

e.g., "select product, useri...product='B0096EZHM2'(Stage"

Issue Links

• is related to: HIVE-9408 Add hook interface so queries can be redacted before being placed in job.xml