[YARN-10246] Enable YARN Router to have a dedicated Zookeeper

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: federation, router
• Assignee: D M Murali Krishna Reddy
• Reporter: D M Murali Krishna Reddy
• Created: 27/Apr/20 21:11
• Updated: 05/May/20 11:32

Description

Currently, we have a single parameter hadoop.zk.address for Router and Resourcemanager, Due to this we need have FederationStateStore and RMStateStore on the same Zookeeper instance.

With the above topology there can be a load on ZooKeeper, since all subcluster RMs will write to single ZooKeeper.

So, If we Introduce a new configuration such as hadoop.federation.zk.address we can have FederationStateStore on a dedicated Zookeeper.

Issue Links

• is related to: HADOOP-14741 Refactor curator based ZooKeeper communication into common library