Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1862

reduces are getting stuck trying to find map outputs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 0.13.0, 0.13.1, 0.14.0, 0.14.1
    • 0.14.2
    • None
    • None

    Description

      Some of the reduces have been stuck for hours looking for 137 map outputs. When I look at the job events all 2600 of the maps have succeeded. There have been lots of lost task trackers and shuffle failures. The maps have been run between 1 to 6 times each. I do see some of the events in the task event log are marked OBSOLETE.

      Attachments

        1. HADOOP-1862_prelim.patch
          3 kB
          Arun Murthy
        2. HADOOP-1862_debug.patch
          4 kB
          Arun Murthy
        3. HADOOP-1862_1_20070912.patch
          17 kB
          Arun Murthy
        4. HADOOP-1862_2_20070927.patch
          17 kB
          Arun Murthy
        5. HADOOP-1862_3_20071002.patch
          17 kB
          Arun Murthy
        6. HADOOP-1862_branch14_1_20071003.patch
          17 kB
          Arun Murthy

        Issue Links

          Activity

            People

              acmurthy Arun Murthy
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: