[HADOOP-15774] Leverage Hadoop Service Registry to discover Hadoop services

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Íñigo Goiri
• Reporter: Íñigo Goiri
• Created: 19/Sep/18 18:41
• Updated: 04/Oct/18 23:21

Description

Currently, Hadoop relies on configuration files to specify the servers.
This requires maintaining these configuration files and propagating the changes.
Hadoop should have a framework to provide discovery.
For example, in HDFS, we could define the Namenodes in a shared location and the DNs would use the framework to find the Namenodes.

Issue Links

• is related to: YARN-8050 Yarn High Availability ZooKeeper based discovery rather than explicit rm1,rm2 configs
• is related to: HADOOP-15821 Move Hadoop YARN Registry to Hadoop Registry
• is related to: HDFS-13312 NameNode High Availability ZooKeeper based discovery rather than explicit nn1,nn2 configs