Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6740

Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.8.0
    • 2.8.0, 3.0.0-alpha2
    • mr-am
    • None
    • Reviewed

    Description

      MAPREDUCE-6242 makes task status update interval configurable to ease the pressure on MR AM to process status updates, but it did not ensure that mapreduce.task.timeout is no smaller than the configured value of task report interval.

      Attachments

        1. mapreduce6740.001.patch
          5 kB
          Haibo Chen
        2. mapreduce6740.002.patch
          5 kB
          Haibo Chen
        3. mapreduce6740.003.patch
          8 kB
          Haibo Chen
        4. mapreduce6740.004.patch
          9 kB
          Haibo Chen
        5. mapreduce6740.005.patch
          10 kB
          Haibo Chen
        6. mapreduce6740.006.patch
          10 kB
          Haibo Chen
        7. mapreduce6740.007.patch
          11 kB
          Haibo Chen
        8. mapreduce6740.008.patch
          11 kB
          Haibo Chen
        9. mapreduce6740.branch-2.8.patch
          11 kB
          Haibo Chen

        Issue Links

        causes

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-7195 Mapreduce task timeout to zero could cause too many status update

        • Major - Major loss of function.
        • Open
        is part of

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-6242 Progress report log is incredibly excessive in application master

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            haibochen Haibo Chen
            haibochen Haibo Chen
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment