[HADOOP-4191] Add a testcase for jobhistory

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.21.0
• Component/s: test
• Hadoop Flags: Reviewed
• Assignee: Ravi Gummadi
• Reporter: Amar Kamat
• Created: 16/Sep/08 19:19
• Updated: 25/Aug/10 00:34
• Resolved: 24/Feb/09 11:01

Description

Changes in job history might break the history parser which in turn might break some features like jobtracker-recovery, history-viewer etc. There should be a testcase that catches these incompatible changes early and informs about the expected change.

This patch validates job history files so that issues related to jobHistory are caught when changes to JobHistory are made.
Validates history file name, file location, parsability. Validates user log location for varoius configuration settings. Validates job status for jobs that are succeeded, failed and killed.
Validates format of history file contents and also validates contents by comparing with actual values obtained from job tracker.

Issue Links

• is blocked by: HADOOP-5282 Running tasks on lost trackers are incorrectly logging the attempt and task failures
• is blocked by: HADOOP-5272 JobTracker does not log TIP start information after restart
• is blocked by: HADOOP-5276 Upon a lost tracker, the task's start time is reset to 0
• is blocked by: HADOOP-5278 Finish time of a TIP is incorrectly logged to the jobhistory upon jobtracker restart