Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3035

MR V2 jobhistory does not contain rack information

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None

      Description

      When topology.node.switch.mapping.impl is set to enable rack-locality resolution via the topology script, from the RM web-UI, we can see the rack information for each node. Running a job also reveals the information about rack-local map tasks launched at end of job completion on the client side.

      But the hostname field for attempts in the JobHistory does not contain this rack information.

      In case of hadoop-0.20 securiy or MRV1, hostname field of job history does contain rackid/hostname whereas in MRV2, hostname field only contains the hostIP. Thus this is a regression.

      1. MAPREDUCE-3035.patch
        16 kB
        chackaravarthy
      2. MAPREDUCE-3035-1.patch
        14 kB
        chackaravarthy
      3. MAPREDUCE-3035-20111031.1.txt
        31 kB
        Vinod Kumar Vavilapalli

        Issue Links

          Activity

            People

            • Assignee:
              chackaravarthy
              Reporter:
              Karam Singh
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development