[MAPREDUCE-2327] MapTask doesn't need to put username information in SpillRecord

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.22.0
• Fix Version/s: 0.22.0
• Hadoop Flags: Reviewed
• Assignee: Todd Lipcon
• Reporter: Todd Lipcon
• Created: 15/Feb/11 01:40
• Updated: 12/Dec/11 06:18
• Resolved: 17/May/11 03:39

Description

This is an amendment to MAPREDUCE-2096 that's found in Yahoo's 0.20.100 branch.

This bug causes task failures in the following case:

• Cluster is not set up with LinuxTaskController (ie not secured cluster)
• Job submitter is not the same as the user running the TT
• Map output is more than one spill's worth

The issue is that UserGroupInformation's view of the current user is the job submitter, but on disk the spill files will be owned by the TT user. SecureIO will then fail when constructing the spill record.

Issue Links

• is blocked by: MAPREDUCE-2445 TestMiniMRWithDFSWithDistinctUsers is very broken