Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4246

Reduce task copy errors may not kill it eventually

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.19.0
    • 0.19.0
    • None
    • None

    Description

      maxFetchRetriesPerMap in reduce task can be zero some times (when maxMapRunTime is less than 4 seconds or mapred.reduce.copy.backoff is less than 4). This will not count reduce task copy errors to kill it eventually.

      Attachments

        1. patch-4246.txt
          3 kB
          Amareshwari Sriramadasu
        2. patch-4246.txt
          3 kB
          Amareshwari Sriramadasu
        3. patch-4246.txt
          2 kB
          Amareshwari Sriramadasu
        4. patch-4246.txt
          5 kB
          Amareshwari Sriramadasu

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            amareshwari Amareshwari Sriramadasu Assign to me
            amareshwari Amareshwari Sriramadasu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment