Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11824

HDFS client and YARN should check for elected master with Zookeeper

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      When trying to connect to a NameNode (DFS) or Resource Manager (Yarn), clients will try multiple connections in order to find the elected master node. Clients should instead check the relevant znode in zookeeper.

      This will be especially valuable in DFS after HDFS-6440 is adopted, as the worst case scenario in the DFS client will then be testing more than one standby nodes in order before finding the master.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                nkedel Nate Edel
                Reporter:
                nkedel Nate Edel
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: