Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6198

NPE from JobTracker#resolveAndAddToTopology in MR1 cause initJob and heartbeat failure.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0
    • Component/s: mrv1
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      NPE from JobTracker#resolveAndAddToTopology in MR1 cause initJob and heartbeat failure. The NPE is caused by dnsToSwitchMapping.resolve return null at the following:

          List <String> rNameList = dnsToSwitchMapping.resolve(tmpList);
          String rName = rNameList.get(0);
      

      I check the code in MR2, MR2 handle it correctly in coreResolve of RackResolver.java

          List <String> rNameList = dnsToSwitchMapping.resolve(tmpList);
          String rName = null;
          if (rNameList == null || rNameList.get(0) == null) {
            rName = NetworkTopology.DEFAULT_RACK;
            LOG.info("Couldn't resolve " + hostName + ". Falling back to "
                + NetworkTopology.DEFAULT_RACK);
          } else {
            rName = rNameList.get(0);
            LOG.info("Resolved " + hostName + " to " + rName);
          }
      

      We should do the same in MR1, if dnsToSwitchMapping.resolve return null, use NetworkTopology.DEFAULT_RACK.

        Attachments

          Activity

            People

            • Assignee:
              zxu zhihai xu
              Reporter:
              zxu zhihai xu
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: