Hadoop Common
  1. Hadoop Common
  2. HADOOP-3327

Shuffling fetchers waited too long between map output fetch re-tries

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    1. patch-3327-2.txt
      10 kB
      Amareshwari Sriramadasu
    2. patch-3327-1.txt
      11 kB
      Amareshwari Sriramadasu
    3. patch-3327.txt
      11 kB
      Amareshwari Sriramadasu
    4. hadoop-3327-v3.patch
      15 kB
      Jothi Padmanabhan
    5. hadoop-3327-v2.patch
      14 kB
      Jothi Padmanabhan
    6. hadoop-3327-v1.patch
      14 kB
      Jothi Padmanabhan
    7. hadoop-3327.patch
      15 kB
      Jothi Padmanabhan

      Issue Links

        Activity

        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Christian Kunz made changes -
        Link This issue is related to MAPREDUCE-1171 [ MAPREDUCE-1171 ]
        Christian Kunz made changes -
        Link This issue is blocked by MAPREDUCE-1171 [ MAPREDUCE-1171 ]
        Christian Kunz made changes -
        Link This issue is blocked by MAPREDUCE-1171 [ MAPREDUCE-1171 ]
        Robert Chansler made changes -
        Release Note Reduces the waitiing time between map output fetch re-tries during the end of the shuffle by aggressively notifying the JobTracker.
        ReadTimeOuts during shuffle are treated differently: Reducer notifies the JobTracker immediately for a readTimeout and backs off for more time.
        Owen O'Malley made changes -
        Component/s mapred [ 12310690 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Amareshwari Sriramadasu made changes -
        Release Note Reduces the waitiing time between map output fetch re-tries during the end of the shuffle by aggressively notifying the JobTracker.
        ReadTimeOuts during shuffle are treated differently: Reducer notifies the JobTracker immediately for a readTimeout and backs off for more time.
        Status Open [ 1 ] Patch Available [ 10002 ]
        Amareshwari Sriramadasu made changes -
        Attachment patch-3327-2.txt [ 12399449 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Amareshwari Sriramadasu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Amareshwari Sriramadasu made changes -
        Attachment patch-3327-1.txt [ 12399348 ]
        Amareshwari Sriramadasu made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Amareshwari Sriramadasu made changes -
        Status Reopened [ 4 ] Patch Available [ 10002 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.21.0 [ 12313563 ]
        Amareshwari Sriramadasu made changes -
        Attachment patch-3327.txt [ 12398057 ]
        Amareshwari Sriramadasu made changes -
        Assignee Jothi Padmanabhan [ jothipn ] Amareshwari Sriramadasu [ amareshwari ]
        Devaraj Das made changes -
        Fix Version/s 0.19.0 [ 12313211 ]
        Nigel Daley made changes -
        Summary Shufflinge fetachers waited too long between map output fetch re-tries Shuffling fetchers waited too long between map output fetch re-tries
        Jothi Padmanabhan made changes -
        Status Resolved [ 5 ] Reopened [ 4 ]
        Resolution Fixed [ 1 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Fix Version/s 0.19.0 [ 12313211 ]
        Hadoop Flags [Reviewed]
        Jothi Padmanabhan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jothi Padmanabhan made changes -
        Attachment hadoop-3327-v3.patch [ 12386719 ]
        Jothi Padmanabhan made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Jothi Padmanabhan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jothi Padmanabhan made changes -
        Attachment hadoop-3327-v2.patch [ 12386262 ]
        Jothi Padmanabhan made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Jothi Padmanabhan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jothi Padmanabhan made changes -
        Attachment hadoop-3327-v1.patch [ 12385858 ]
        Devaraj Das made changes -
        Assignee Sam Pullara [ spullara ] Jothi Padmanabhan [ jothipn ]
        Devaraj Das made changes -
        Assignee Jothi Padmanabhan [ jothipn ] Sam Pullara [ spullara ]
        Status Patch Available [ 10002 ] Open [ 1 ]
        Jothi Padmanabhan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jothi Padmanabhan made changes -
        Attachment hadoop-3327.patch [ 12384737 ]
        Jothi Padmanabhan made changes -
        Assignee Jothi Padmanabhan [ jothipn ]
        Runping Qi made changes -
        Link This issue relates to HADOOP-3297 [ HADOOP-3297 ]
        Runping Qi made changes -
        Field Original Value New Value
        Summary Shuffling fetch read timeout/jetty connection timeout Shufflinge fetachers waited too long between map output fetch re-tries
        Runping Qi created issue -

          People

          • Assignee:
            Amareshwari Sriramadasu
            Reporter:
            Runping Qi
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development