Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13312

NameNode High Availability ZooKeeper based discovery rather than explicit nn1,nn2 configs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.9.1
    • None
    • ha, hdfs, namenode, nn
    • None

    Description

      Improvement Request for HDFS NameNode HA to use ZooKeeper based dynamic discovery rather than explicitly setting the NameNode addresses via nn1,n2 in the configs.

      One proprietary Hadoop vendor already uses ZK for Resource Manager HA discovery - it makes sense that the open source core should do this for both Yarn and HDFS.

      Attachments

        1. HDFS-13312.000.patch
          13 kB
          Íñigo Goiri
        2. HDFS-13312.001.patch
          39 kB
          Íñigo Goiri
        3. HDFS-13312.002.patch
          49 kB
          Íñigo Goiri
        4. HDFS-13312.003.patch
          53 kB
          Íñigo Goiri

        Issue Links

          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. HDFS-13098 RBF: Datanodes interacting with Routers

          • Major - Major loss of function.
          • Open
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-15774 Leverage Hadoop Service Registry to discover Hadoop services

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. HDFS-14118 Support using DNS to resolve nameservices to IP addresses

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-8050 Yarn High Availability ZooKeeper based discovery rather than explicit rm1,rm2 configs

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              harisekhon Hari Sekhon
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated: