Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2355

Federation: enable using the same configuration file across all the nodes in the cluster.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.
      Show
      This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.

      Description

      In federation the configuration files xml include another configuration xml. This configuration xml is empty for datanodes and defines nameservice ID for namenodes, secondary and backup nodes. The need for xml include can be eliminated by namenodes determining the nameservice ID by matching its local address with a configured address (such as namenode rpc address) and on match using the nameservice ID of the corresponding configuration parameter.

      For more details about federation configuration see https://issues.apache.org/jira/browse/HDFS-1689?focusedCommentId=13001749&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13001749

      1. HDFS-2355.txt
        21 kB
        Suresh Srinivas
      2. HDFS-2355.txt
        22 kB
        Suresh Srinivas

        Issue Links

          Activity

            People

            • Assignee:
              Suresh Srinivas
              Reporter:
              Suresh Srinivas
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development