Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-801

job tracker should keep a log of task completion and failure

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.1
    • Fix Version/s: 0.11.0
    • Component/s: None
    • Labels:
      None

      Description

      The JobTracker should track a list of task completion events in JobInProgress.

      So JobClientProtocol & InterTrackerProtocol should get a new method:

      TaskCompletionEvent[] getTaskCompletionEvents(String jobid, int fromEventId) throws IOException;

      TaskCompletionEvent should have:
      int getEventId();
      String getTaskTrackerHttp();
      String getTaskId();
      static public enum Status

      {FAILED, SUCCEEDED}

      ;
      Status getTaskStatus();
      }

      The events will be stored in a List<TaskCompletionEvent> and the eventId is the position in the list.

      These event logs will allow JobClient to display task output to the user as well as provide the start of the fix for HADOOP-248.

        Attachments

        1. Hadoop-801.patch
          13 kB
          Sanjay Dahiya
        2. Hadoop-801.patch
          17 kB
          Sanjay Dahiya
        3. Hadoop-801.patch
          18 kB
          Sanjay Dahiya
        4. Hadoop-801.patch
          19 kB
          Sanjay Dahiya

          Issue Links

            Activity

              People

              • Assignee:
                sanjay.dahiya Sanjay Dahiya
                Reporter:
                omalley Owen O'Malley
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: