Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9332

RackResolver tool should accept multiple hosts

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.9.2, 3.0.3, 2.8.5, 2.7.7, 3.1.2
    • Fix Version/s: 3.3.0, 3.2.1
    • Component/s: yarn
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      RackResolver as a public rack resolver tool only offers a method public static Node resolve(String hostName) which only accepts one host a time. Actually the internal implementation class DNSToSwitchMapping always accept a host list as its input and return a list of resolved racks. That's cause the invoker like Spark takes a long time to resolve the rack info when handling abundant tasks (a mass of loops to execute script to resolve rack info).

        Attachments

        1. YARN-9332.003.patch
          8 kB
          Lantao Jin
        2. YARN-9332.002.patch
          7 kB
          Lantao Jin
        3. YARN-9332.001.patch
          7 kB
          Lantao Jin

          Issue Links

            Activity

              People

              • Assignee:
                cltlfcjin Lantao Jin
                Reporter:
                cltlfcjin Lantao Jin
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: