Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11824

HDFS client and YARN should check for elected master with Zookeeper

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      When trying to connect to a NameNode (DFS) or Resource Manager (Yarn), clients will try multiple connections in order to find the elected master node. Clients should instead check the relevant znode in zookeeper.

      This will be especially valuable in DFS after HDFS-6440 is adopted, as the worst case scenario in the DFS client will then be testing more than one standby nodes in order before finding the master.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            nkedel Nate Edel
            nkedel Nate Edel

            Dates

              Created:
              Updated:

              Slack

                Issue deployment