Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-597

transmission errors to the reduce will cause map output to be considered lost

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.7.0
    • 0.7.1
    • None
    • None

    Description

      When the mapOutput servlet gets an IOException from reading the map output file, it correctly declares the map output lost. However, an IOException writing to the socket should NOT cause the map output to be declared lost. Unfortunately, the current implementation always declares the map output lost. When the map output is lost, the map is re-run on a different computer.

      Attachments

        1. map-output-protect.patch
          2 kB
          Owen O'Malley
        2. map-output-protect-2.patch
          2 kB
          Owen O'Malley

        Activity

          People

            omalley Owen O'Malley
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: