[HDFS-15831] Adopt more DNS resolving for HDFS

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Fengnan Li
• Reporter: Fengnan Li
• Created: 10/Feb/21 11:06
• Updated: 27/Aug/21 01:11

Description

There are some opportunities inside HDFS where we can use DNS for hosts instead of host names. This will help to a large extent in two aspects:
1. Server management, i.e. host replacement
2. Client transparency, i.e. client config with DNS without knowing the specific host.

It is worth mentioning that secure environment should be supported, we recommend having the principal wildcard matching turned on.

Issue Links

• is a parent of: HDFS-14601 NameNode HA with single DNS record for NameNode discovery prevent running ZKFC
• is a parent of: HDFS-14118 Support using DNS to resolve nameservices to IP addresses
• is a parent of: HDFS-14310 Improve documents for using DNS to resolve namenodes and routers
• is a parent of: HDFS-15833 Make ObserverReadProxyProvider able to talk to DNS of Observers
• is a parent of: HDFS-16133 Support refresh of IP addresses behind DNS for clients
• is a parent of: HDFS-15832 Using DNS to access Zookeeper cluster
• is a parent of: HDFS-15785 Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes
• is a parent of: HDFS-16188 RBF: Router to support resolving monitored namenodes with DNS
• is related to: HDFS-16157 Support configuring DNS record to get list of journal nodes.