Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3035

MR V2 jobhistory does not contain rack information

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • mrv2
    • None

    Description

      When topology.node.switch.mapping.impl is set to enable rack-locality resolution via the topology script, from the RM web-UI, we can see the rack information for each node. Running a job also reveals the information about rack-local map tasks launched at end of job completion on the client side.

      But the hostname field for attempts in the JobHistory does not contain this rack information.

      In case of hadoop-0.20 securiy or MRV1, hostname field of job history does contain rackid/hostname whereas in MRV2, hostname field only contains the hostIP. Thus this is a regression.

      Attachments

        1. MAPREDUCE-3035.patch
          16 kB
          chackaravarthy
        2. MAPREDUCE-3035-1.patch
          14 kB
          chackaravarthy
        3. MAPREDUCE-3035-20111031.1.txt
          31 kB
          Vinod Kumar Vavilapalli

        Issue Links

          Activity

            People

              chaku88 chackaravarthy
              karams Karam Singh
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: