Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6740

Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha2
    • Component/s: mr-am
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      MAPREDUCE-6242 makes task status update interval configurable to ease the pressure on MR AM to process status updates, but it did not ensure that mapreduce.task.timeout is no smaller than the configured value of task report interval.

        Attachments

        1. mapreduce6740.001.patch
          5 kB
          Haibo Chen
        2. mapreduce6740.002.patch
          5 kB
          Haibo Chen
        3. mapreduce6740.003.patch
          8 kB
          Haibo Chen
        4. mapreduce6740.004.patch
          9 kB
          Haibo Chen
        5. mapreduce6740.005.patch
          10 kB
          Haibo Chen
        6. mapreduce6740.006.patch
          10 kB
          Haibo Chen
        7. mapreduce6740.007.patch
          11 kB
          Haibo Chen
        8. mapreduce6740.008.patch
          11 kB
          Haibo Chen
        9. mapreduce6740.branch-2.8.patch
          11 kB
          Haibo Chen

          Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-7195 Mapreduce task timeout to zero could cause too many status update

          • Major - Major loss of function.
          • Open
          is part of

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-6242 Progress report log is incredibly excessive in application master

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                haibochen Haibo Chen
                Reporter:
                haibochen Haibo Chen
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: