Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4496

Improve HA ResourceManager Failover detection on the client

    XMLWordPrintableJSON

Details

    Description

      HDFS deployments can currently use the RequestHedgingProxyProvider to improve Namenode failover detection in the client. It does this by concurrently trying all namenodes and picks the namenode that returns the fastest with a successful response as the active node.

      It would be useful to have a similar ProxyProvider for the Yarn RM (it can possibly be done by converging some the class hierarchies to use the same ProxyProvider)

      This would especially be useful for large YARN deployments with multiple standby RMs where clients will be able to pick the active RM without having to traverse a list of configured RMs.

      Attachments

        1. YARN-4496.6.patch
          22 kB
          Jian He
        2. YARN-4496.5.patch
          22 kB
          Jian He
        3. YARN-4496.4.patch
          22 kB
          Jian He
        4. YARN-4496.3.patch
          23 kB
          Jian He
        5. YARN-4496.2.patch
          23 kB
          Jian He
        6. YARN-4496.1.patch
          23 kB
          Jian He

        Issue Links

          Activity

            People

              jianhe Jian He
              asuresh Arun Suresh
              Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: