[HDFS-2582] Scope dfs.ha.namenodes config by nameservice

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: HA branch (HDFS-1623)
• Fix Version/s: HA branch (HDFS-1623)
• Component/s: datanode, ha, namenode
• Target Version/s: HA branch (HDFS-1623)
• Hadoop Flags: Reviewed
• Assignee: Todd Lipcon
• Reporter: Todd Lipcon
• Created: 22/Nov/11 01:17
• Updated: 24/Jan/12 19:50
• Resolved: 29/Nov/11 02:28

Description

HDFS-2231 started the process of adding configuration for HA, but one piece is missing. The current state of the configuration is, I believe:
dfs.ha.namenodes - a list of identifiers for HA namenodes
dfs.federation.nameservices - a list of federated nameservices
dfs.namenode.rpc-address[.nameservice-id][.namenode-id] - some specific config for the given namenode. If HA or federation is disabled, the extra components can be elided for backwards compatibility.

The issue here is that there is no easy way to discern which NN is paired with which other NN. Additionally, adding a new federated nameservice to a config will require changes to dfs.ha.namenodes which makes templating harder. It would be simpler to change dfs.ha.namenodes to be nameservice-scoped: dfs.ha.namenodes.<nameservice-id>.