Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9974

Sensitive data redaction: data appears in name of mapreduce job

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 1.3.0, 2.0.0
    • None
    • None

    Description

      Set up a cluster, configured a redaction rule to redact "B0096EZHM2", and ran Hive queries on the cluster.

      Looking at the YARN RM web UI and Job History Server web UI, I see that the mapreduce jobs spawned by the Hive queries have the sensitive data ("B0096EZHM2") showing in the job names:

      e.g., "select product, useri...product='B0096EZHM2'(Stage"

      Attachments

        1. HIVE-9974.1.patch
          0.9 kB
          Sergio Peña

        Issue Links

        is related to

        Task - A task that needs to be done. HIVE-9408 Add hook interface so queries can be redacted before being placed in job.xml

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            spena Sergio Peña Assign to me
            spena Sergio Peña
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment