[MAPREDUCE-3755] Add the equivalent of JobStatus to end of JobHistory file

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.23.0
• Fix Version/s: 0.23.2
• Component/s: jobhistoryserver, mrv2
• Target Version/s: 0.23.3, 2.0.0-alpha
• Assignee: Bikas Saha
• Reporter: Arun Murthy
• Created: 29/Jan/12 23:12
• Updated: 22/Apr/14 17:06
• Resolved: 22/Apr/14 17:06

Description

In MR1 we have the notion of CompletedJobStatus store to aid fast responses to job.getStatus. We need the equivalent for MR2, an option is to add the jobStatus to the end of the JobHistory file to which the JHS can easily jump ahead to and serve the query, it should also cache this for a fair number of recently completed jobs.

Issue Links

• relates to: MAPREDUCE-4442 Accessing hadoop counters from a job is unreliable in yarn during AM process cleanup window