Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9332

RackResolver tool should accept multiple hosts

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.9.2, 3.0.3, 2.8.5, 2.7.7, 3.1.2
    • 3.3.0, 3.2.1
    • yarn
    • None
    • Reviewed

    Description

      RackResolver as a public rack resolver tool only offers a method public static Node resolve(String hostName) which only accepts one host a time. Actually the internal implementation class DNSToSwitchMapping always accept a host list as its input and return a list of resolved racks. That's cause the invoker like Spark takes a long time to resolve the rack info when handling abundant tasks (a mass of loops to execute script to resolve rack info).

      Attachments

        1. YARN-9332.003.patch
          8 kB
          Lantao Jin
        2. YARN-9332.002.patch
          7 kB
          Lantao Jin
        3. YARN-9332.001.patch
          7 kB
          Lantao Jin

        Issue Links

          Activity

            People

              cltlfcjin Lantao Jin
              cltlfcjin Lantao Jin
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: