[HDFS-2355] Federation: enable using the same configuration file across all the nodes in the cluster.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.23.0
• Fix Version/s: 0.23.0
• Component/s: namenode
• Hadoop Flags: Reviewed

Release Note

This change allows when running multiple namenodes on different hosts, sharing the same configuration file across all the nodes in the cluster (Datanodes, NamNode, BackupNode, SecondaryNameNode), without the need to define dfs.federation.nameservice.id parameter.

• Assignee: Suresh Srinivas
• Reporter: Suresh Srinivas
• Created: 21/Sep/11 21:19
• Updated: 16/Mar/15 18:07
• Resolved: 28/Sep/11 23:00

Description

In federation the configuration files xml include another configuration xml. This configuration xml is empty for datanodes and defines nameservice ID for namenodes, secondary and backup nodes. The need for xml include can be eliminated by namenodes determining the nameservice ID by matching its local address with a configured address (such as namenode rpc address) and on match using the nameservice ID of the corresponding configuration parameter.

For more details about federation configuration see https://issues.apache.org/jira/browse/HDFS-1689?focusedCommentId=13001749&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13001749

Issue Links

• is related to: HDFS-1689 Hdfs Federation: Configuration for namenodes