Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4496

Improve HA ResourceManager Failover detection on the client

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      HDFS deployments can currently use the RequestHedgingProxyProvider to improve Namenode failover detection in the client. It does this by concurrently trying all namenodes and picks the namenode that returns the fastest with a successful response as the active node.

      It would be useful to have a similar ProxyProvider for the Yarn RM (it can possibly be done by converging some the class hierarchies to use the same ProxyProvider)

      This would especially be useful for large YARN deployments with multiple standby RMs where clients will be able to pick the active RM without having to traverse a list of configured RMs.

      Attachments

        1. YARN-4496.1.patch
          23 kB
          Jian He
        2. YARN-4496.2.patch
          23 kB
          Jian He
        3. YARN-4496.3.patch
          23 kB
          Jian He
        4. YARN-4496.4.patch
          22 kB
          Jian He
        5. YARN-4496.5.patch
          22 kB
          Jian He
        6. YARN-4496.6.patch
          22 kB
          Jian He

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jianhe Jian He
            asuresh Arun Suresh
            Votes:
            1 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment