Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2237

Lost heartbeat response containing MapTask throws NPE when it is resent

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • 0.20.2, 0.21.0, 0.22.0
    • None
    • jobtracker
    • None

    Description

      When the JT sends a heartbeat response, it records it in trackerToHeartbeatResponseMap. But after MapTask writes its input split, it sets that split to null (assumedly to save memory?). So, if the heartbeat response is lost, and the JT needs to resend it, it will throw NPE since the split information has been lost.

      Attachments

        1. MAPREDUCE-2237-0.20.patch
          2 kB
          Devaraj Kavali
        2. MAPREDUCE-2237-0.23.1.patch
          2 kB
          Devaraj Kavali
        3. MAPREDUCE-2237-0.23.2.patch
          3 kB
          Devaraj Kavali
        4. MAPREDUCE-2237-0.23.patch
          2 kB
          Devaraj Kavali

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-2464 NullPointerException is coming in the job tracker when job tracker resends the previous heartbeat response.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              devaraj Devaraj Kavali
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: