Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2206

The task-cleanup tasks should be optional

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • jobtracker
    • None
    • Reviewed

    Description

      For job does not use OutputCommitter.abort(), this should be able to turn off.
      This improves the latency of the job because failed tasks are often the bottleneck of the jobs.

      Attachments

        1. MAPREDUCE-2206.txt
          12 kB
          Scott Chen

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-1833 Task-cleanup task should be disabled

          • Major - Major loss of function.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-2207 Task-cleanup task should not be scheduled on the node that the task just failed

          • Major - Major loss of function.
          • Closed

          Activity

            People

              schen Scott Chen
              schen Scott Chen
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: