Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-538

RM address DNS lookup can cause unnecessary slowness on every JHS page load

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.3-alpha
    • 2.1.0-beta
    • None
    • None
    • Reviewed

    Description

      When I run the job history server locally, every page load takes in the 10s of seconds. I profiled the process and discovered that all the extra time was spent inside YarnConfiguration#getRMWebAppURL, trying to resolve 0.0.0.0 to a hostname. When I changed my yarn.resourcemanager.address to localhost, the page load times decreased drastically.

      There's no that we need to perform this resolution on every page load.

      Attachments

        1. MAPREDUCE-5111.patch
          2 kB
          Sandy Ryza

        Activity

          People

            sandyr Sandy Ryza
            sandyr Sandy Ryza
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: