Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9775

Add tracking IDs to FS tokens to allow tracing FS operations back to job

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.1.0-beta
    • Fix Version/s: None
    • Component/s: security
    • Labels:
      None

      Description

      It would be helpful for auditing to allow tracing of file system operations to the higher-level operations that encompass them (e.g. MR jobs).

      Approaches to achieving this by logging delegation token sequence numbers at job start were discussed on MAPREDUCE-5379, but rejected because delegation token identifiers are meant to be opaque.

      Per discussion between Tucu and Daryn, a better way to do this would be to include a tracking ID with delegation tokens. When requesting a delegation token, a job would be able to pass its job ID along to be included with the token.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sandyr Sandy Ryza
                Reporter:
                sandyr Sandy Ryza
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: