Hadoop Common
  1. Hadoop Common
  2. HADOOP-1862

reduces are getting stuck trying to find map outputs

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.13.0, 0.13.1, 0.14.0, 0.14.1
    • Fix Version/s: 0.14.2
    • Component/s: None
    • Labels:
      None

      Description

      Some of the reduces have been stuck for hours looking for 137 map outputs. When I look at the job events all 2600 of the maps have succeeded. There have been lots of lost task trackers and shuffle failures. The maps have been run between 1 to 6 times each. I do see some of the events in the task event log are marked OBSOLETE.

      1. HADOOP-1862_prelim.patch
        3 kB
        Arun C Murthy
      2. HADOOP-1862_debug.patch
        4 kB
        Arun C Murthy
      3. HADOOP-1862_branch14_1_20071003.patch
        17 kB
        Arun C Murthy
      4. HADOOP-1862_3_20071002.patch
        17 kB
        Arun C Murthy
      5. HADOOP-1862_2_20070927.patch
        17 kB
        Arun C Murthy
      6. HADOOP-1862_1_20070912.patch
        17 kB
        Arun C Murthy

        Issue Links

          Activity

          Owen O'Malley made changes -
          Component/s mapred [ 12310690 ]
          Devaraj Das made changes -
          Status Reopened [ 4 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Attachment HADOOP-1862_branch14_1_20071003.patch [ 12366950 ]
          Devaraj Das made changes -
          Status Resolved [ 5 ] Reopened [ 4 ]
          Resolution Fixed [ 1 ]
          Devaraj Das made changes -
          Resolution Fixed [ 1 ]
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment HADOOP-1862_3_20071002.patch [ 12366927 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Devaraj Das made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Arun C Murthy made changes -
          Attachment HADOOP-1862_2_20070927.patch [ 12366638 ]
          Arun C Murthy made changes -
          Attachment HADOOP-1862_1_20070912.patch [ 12365639 ]
          Arun C Murthy made changes -
          Assignee Owen O'Malley [ owen.omalley ] Arun C Murthy [ acmurthy ]
          Owen O'Malley made changes -
          Link This issue is duplicated by HADOOP-1374 [ HADOOP-1374 ]
          Owen O'Malley made changes -
          Fix Version/s 0.15.0 [ 12312565 ]
          Affects Version/s 0.13.1 [ 12312579 ]
          Affects Version/s 0.14.0 [ 12312474 ]
          Fix Version/s 14.2 [ 12312762 ]
          Affects Version/s 0.13.0 [ 12312348 ]
          Arun C Murthy made changes -
          Attachment HADOOP-1862_debug.patch [ 12365547 ]
          Arun C Murthy made changes -
          Attachment HADOOP-1862_debug.patch [ 12365546 ]
          Arun C Murthy made changes -
          Attachment HADOOP-1862_debug.patch [ 12365546 ]
          Arun C Murthy made changes -
          Field Original Value New Value
          Attachment HADOOP-1862_prelim.patch [ 12365476 ]
          Owen O'Malley created issue -

            People

            • Assignee:
              Arun C Murthy
              Reporter:
              Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development