[YARN-8333] Load balance YARN services using RegistryDNS multiple A records

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.2.0, 3.1.1
• Component/s: yarn-native-services
• Assignee: Eric Yang
• Reporter: Eric Yang
• Created: 21/May/18 16:13
• Updated: 31/May/18 15:49
• Resolved: 31/May/18 14:11

Description

For scaling stateless containers, it would be great to support DNS round robin for fault tolerance and load balancing. The current DNS record format for RegistryDNS is [container-instance].[application-name].[username].[domain]. For example:

appcatalog-0.appname.hbase.ycluster. IN A 123.123.123.120
appcatalog-1.appname.hbase.ycluster. IN A 123.123.123.121
appcatalog-2.appname.hbase.ycluster. IN A 123.123.123.122
appcatalog-3.appname.hbase.ycluster. IN A 123.123.123.123

It would be nice to add multi-A record that contains all IP addresses of the same component in addition to the instance based records. For example:

appcatalog.appname.hbase.ycluster. IN A 123.123.123.120
appcatalog.appname.hbase.ycluster. IN A 123.123.123.121
appcatalog.appname.hbase.ycluster. IN A 123.123.123.122
appcatalog.appname.hbase.ycluster. IN A 123.123.123.123