Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly.

      Description

      BlockLocation.getHosts() returns IP addresses occasionally. Data locality is affected - since the RM requires hostnames.

      1. MR3815.txt
        10 kB
        Siddharth Seth

        Issue Links

          Activity

          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Vinod Kumar Vavilapalli made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Release Note Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly.
          Fix Version/s 0.23.1 [ 12318883 ]
          Resolution Fixed [ 1 ]
          Siddharth Seth made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Siddharth Seth made changes -
          Attachment MR3815.txt [ 12513668 ]
          Siddharth Seth made changes -
          Summary Data Locality suffers if HDFS returns IPs in getFileBlockLocations Data Locality suffers if the AM asks for containers using IPs instead of hostnames
          Siddharth Seth made changes -
          Link This issue blocks MAPREDUCE-3524 [ MAPREDUCE-3524 ]
          Siddharth Seth made changes -
          Field Original Value New Value
          Assignee Siddharth Seth [ sseth ]
          Siddharth Seth created issue -

            People

            • Assignee:
              Siddharth Seth
              Reporter:
              Siddharth Seth
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development