Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2355

Federation: enable using the same configuration file across all the nodes in the cluster.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • namenode
    • None
    • Reviewed
    • Hide
      This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.
      Show
      This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.

    Description

      In federation the configuration files xml include another configuration xml. This configuration xml is empty for datanodes and defines nameservice ID for namenodes, secondary and backup nodes. The need for xml include can be eliminated by namenodes determining the nameservice ID by matching its local address with a configured address (such as namenode rpc address) and on match using the nameservice ID of the corresponding configuration parameter.

      For more details about federation configuration see https://issues.apache.org/jira/browse/HDFS-1689?focusedCommentId=13001749&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13001749

      Attachments

        1. HDFS-2355.txt
          22 kB
          Suresh Srinivas
        2. HDFS-2355.txt
          21 kB
          Suresh Srinivas

        Issue Links

          Activity

            People

              sureshms Suresh Srinivas
              sureshms Suresh Srinivas
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: