[HADOOP-801] job tracker should keep a log of task completion and failure

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.1
• Fix Version/s: 0.11.0
• Assignee: Sanjay Dahiya
• Reporter: Owen O'Malley
• Created: 08/Dec/06 00:36
• Updated: 02/May/13 02:29
• Resolved: 16/Jan/07 21:30

Description

The JobTracker should track a list of task completion events in JobInProgress.

So JobClientProtocol & InterTrackerProtocol should get a new method:

TaskCompletionEvent[] getTaskCompletionEvents(String jobid, int fromEventId) throws IOException;

TaskCompletionEvent should have:
int getEventId();
String getTaskTrackerHttp();
String getTaskId();
static public enum Status

{FAILED, SUCCEEDED}

;
Status getTaskStatus();
}

The events will be stored in a List<TaskCompletionEvent> and the eventId is the position in the list.

These event logs will allow JobClient to display task output to the user as well as provide the start of the fix for HADOOP-248.

Issue Links

• is depended upon by: HADOOP-248 locating map outputs via random probing is inefficient
• is depended upon by: HADOOP-805 JobClient should print the Task's stdout and stderr to the clients console