Hadoop Common
  1. Hadoop Common
  2. HADOOP-4714

map tasks timing out during merge phase

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.18.1
    • Fix Version/s: 0.18.3
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      With compression of transient data turned on some parts of the merge phase seem to not report progress enough.

      We see a lot of task failures during the merge phase, most of them timing out (even with a 20 min timeout)

      1. hadoop-4714.patch
        13 kB
        Jothi Padmanabhan
      2. hadoop-4714-v1.patch
        4 kB
        Jothi Padmanabhan
      3. hadoop-4714-18.patch
        4 kB
        Jothi Padmanabhan
      4. hadoop-4714-19.patch
        4 kB
        Jothi Padmanabhan

        Activity

        Christian Kunz created issue -
        Jothi Padmanabhan made changes -
        Field Original Value New Value
        Attachment hadoop-4714.patch [ 12394905 ]
        Jothi Padmanabhan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Assignee Jothi Padmanabhan [ jothipn ]
        Chris Douglas made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Jothi Padmanabhan made changes -
        Attachment hadoop-4714-v1.patch [ 12394994 ]
        Jothi Padmanabhan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jothi Padmanabhan made changes -
        Attachment hadoop-4714-18.patch [ 12395093 ]
        Attachment hadoop-4714-19.patch [ 12395094 ]
        Chris Douglas made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.18.3 [ 12313494 ]
        Resolution Fixed [ 1 ]
        Hadoop Flags [Reviewed]
        Nigel Daley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Owen O'Malley made changes -
        Component/s mapred [ 12310690 ]

          People

          • Assignee:
            Jothi Padmanabhan
            Reporter:
            Christian Kunz
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development