Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-863 Improve/standardize job history file content format and the management of the history files
  3. MAPREDUCE-814

Move completed Job history files to HDFS

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • jobtracker
    • None
    • Reviewed
    • Provides an ability to move completed job history files to a HDFS location via configuring "mapred.job.tracker.history.completed.location". If the directory location does not already exist, it would be created by jobtracker.

    Description

      Currently completed job history files remain on the jobtracker node. Having the files available on HDFS will enable clients to access these files more easily.

      Attachments

        1. 814_v1.patch
          6 kB
          Sharad Agarwal
        2. 814_v2.patch
          11 kB
          Sharad Agarwal
        3. 814_v3.patch
          23 kB
          Sharad Agarwal
        4. 814_v4.patch
          27 kB
          Sharad Agarwal
        5. 814_v5.patch
          26 kB
          Sharad Agarwal
        6. 814_ydist.patch
          28 kB
          Sharad Agarwal

        Issue Links

          blocks

          Sub-task - The sub-task of the issue MAPREDUCE-817 Add a cache for retired jobs with minimal job info and provide a way to access history file url

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sharadag Sharad Agarwal
              sharadag Sharad Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: