Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2355

Federation: enable using the same configuration file across all the nodes in the cluster.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0, 0.24.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.
      Show
      This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.

      Description

      In federation the configuration files xml include another configuration xml. This configuration xml is empty for datanodes and defines nameservice ID for namenodes, secondary and backup nodes. The need for xml include can be eliminated by namenodes determining the nameservice ID by matching its local address with a configured address (such as namenode rpc address) and on match using the nameservice ID of the corresponding configuration parameter.

      For more details about federation configuration see https://issues.apache.org/jira/browse/HDFS-1689?focusedCommentId=13001749&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13001749

      1. HDFS-2355.txt
        21 kB
        Suresh Srinivas
      2. HDFS-2355.txt
        22 kB
        Suresh Srinivas

        Issue Links

          Activity

          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Tsz Wo Nicholas Sze made changes -
          Fix Version/s 0.23.0 [ 12315571 ]
          Suresh Srinivas made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Release Note This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.
          Resolution Fixed [ 1 ]
          Suresh Srinivas made changes -
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 0.24.0 [ 12317653 ]
          Affects Version/s 0.23.0 [ 12315571 ]
          Component/s name-node [ 12312926 ]
          Suresh Srinivas made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suresh Srinivas made changes -
          Attachment HDFS-2355.txt [ 12496916 ]
          Suresh Srinivas made changes -
          Attachment HDFS-2355.txt [ 12495446 ]
          Suresh Srinivas made changes -
          Field Original Value New Value
          Link This issue is related to HDFS-1689 [ HDFS-1689 ]
          Suresh Srinivas created issue -

            People

            • Assignee:
              Suresh Srinivas
              Reporter:
              Suresh Srinivas
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development