Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3561 [Umbrella ticket] Performance issues in YARN+MR
  3. MAPREDUCE-3815

Data Locality suffers if the AM asks for containers using IPs instead of hostnames

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.23.0
    • 0.23.1
    • mrv2
    • None
    • Reviewed
    • Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly.

    Description

      BlockLocation.getHosts() returns IP addresses occasionally. Data locality is affected - since the RM requires hostnames.

      Attachments

        1. MR3815.txt
          10 kB
          Siddharth Seth

        Issue Links

          Activity

            People

              sseth Siddharth Seth
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: