[HADOOP-9775] Add tracking IDs to FS tokens to allow tracing FS operations back to job

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.1.0-beta
• Component/s: security
• Assignee: Sandy Ryza
• Reporter: Sandy Ryza
• Created: 26/Jul/13 01:11
• Updated: 08/Oct/13 19:06
• Resolved: 08/Oct/13 19:06

Description

It would be helpful for auditing to allow tracing of file system operations to the higher-level operations that encompass them (e.g. MR jobs).

Approaches to achieving this by logging delegation token sequence numbers at job start were discussed on MAPREDUCE-5379, but rejected because delegation token identifiers are meant to be opaque.

Per discussion between Tucu and Daryn, a better way to do this would be to include a tracking ID with delegation tokens. When requesting a delegation token, a job would be able to pass its job ID along to be included with the token.

Issue Links

• relates to: HDFS-4680 Audit logging of delegation tokens for MR tracing
• relates to: MAPREDUCE-5379 Include token tracking ids in jobconf