Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1941

Need a servlet in JobTracker to stream contents of the job history file

    Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.22.0
    • Fix Version/s: None
    • Component/s: jobtracker
    • Labels:
      None

      Description

      There is no convenient mechanism to retrieve the contents of the job history file. Need a way to retrieve the job history file contents from Job Tracker.

      This can perhaps be implemented as a servlet on the Job tracker.

      • Create a jsp/servlet that accepts job id as a request parameter
      • Stream the contents of the history file corresponding to the job id, if user has permissions to view the job details.

        Issue Links

          Activity

          Hide
          Srikanth Sundarrajan added a comment -

          This can be done in Job client itself, no? History url is already available in JobStatus.

          While the history file name may be available through JobStatus, the history file is owned by user who runs the job tracker. However access to history file should be governed by JobACL.VIEW_JOB. Hence the request to have a separate servlet to provide job history file contents.

          Show
          Srikanth Sundarrajan added a comment - This can be done in Job client itself, no? History url is already available in JobStatus. While the history file name may be available through JobStatus, the history file is owned by user who runs the job tracker. However access to history file should be governed by JobACL.VIEW_JOB. Hence the request to have a separate servlet to provide job history file contents.
          Hide
          Amareshwari Sriramadasu added a comment -

          This can be done in Job client itself, no? History url is already available in JobStatus.

          Show
          Amareshwari Sriramadasu added a comment - This can be done in Job client itself, no? History url is already available in JobStatus.
          Hide
          Srikanth Sundarrajan added a comment -

          The new servlet to provide the raw history contents should perhaps be hosted on an independent history server to avoid burdening the job tracker.

          Show
          Srikanth Sundarrajan added a comment - The new servlet to provide the raw history contents should perhaps be hosted on an independent history server to avoid burdening the job tracker.

            People

            • Assignee:
              Srikanth Sundarrajan
              Reporter:
              Srikanth Sundarrajan
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:

                Development