Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4714

map tasks timing out during merge phase

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.18.1
    • 0.18.3
    • None
    • None
    • Reviewed

    Description

      With compression of transient data turned on some parts of the merge phase seem to not report progress enough.

      We see a lot of task failures during the merge phase, most of them timing out (even with a 20 min timeout)

      Attachments

        1. hadoop-4714.patch
          13 kB
          Jothi Padmanabhan
        2. hadoop-4714-v1.patch
          4 kB
          Jothi Padmanabhan
        3. hadoop-4714-18.patch
          4 kB
          Jothi Padmanabhan
        4. hadoop-4714-19.patch
          4 kB
          Jothi Padmanabhan

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jothipn Jothi Padmanabhan
            ckunz Christian Kunz
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment