Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3035

MR V2 jobhistory does not contain rack information

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None

      Description

      When topology.node.switch.mapping.impl is set to enable rack-locality resolution via the topology script, from the RM web-UI, we can see the rack information for each node. Running a job also reveals the information about rack-local map tasks launched at end of job completion on the client side.

      But the hostname field for attempts in the JobHistory does not contain this rack information.

      In case of hadoop-0.20 securiy or MRV1, hostname field of job history does contain rackid/hostname whereas in MRV2, hostname field only contains the hostIP. Thus this is a regression.

        Attachments

        1. MAPREDUCE-3035-20111031.1.txt
          31 kB
          Vinod Kumar Vavilapalli
        2. MAPREDUCE-3035-1.patch
          14 kB
          chackaravarthy
        3. MAPREDUCE-3035.patch
          16 kB
          chackaravarthy

          Issue Links

            Activity

              People

              • Assignee:
                chaku88 chackaravarthy
                Reporter:
                karams Karam Singh
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: