[MAPREDUCE-2666] MR-279: Need to retrieve shuffle port number on ApplicationMaster restart

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.0
• Fix Version/s: 0.23.0
• Component/s: mrv2
• Target Version/s: 0.23.0
• Assignee: Jonathan Turner Eagles
• Reporter: Robert Joseph Evans
• Created: 08/Jul/11 20:44
• Updated: 15/Nov/11 00:48
• Resolved: 12/Oct/11 23:13

Description

MAPREDUCE-2652 allows ShuffleHandler to return the port it is operating on. In the case of an ApplicationMaster crash where it needs to be restarted that information is lost. We either need to re-query it from each of the NodeManagers or to persist it to the JobHistory logs and retrieve it again. The job history logs is probably the simpler solution.