Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-16685

DataNode registration fails because getHostName returns an IP address

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • 3.4.0, 3.3.5
    • None
    • namenode
    • None
    • Run in Kubernetes using Java 11.  

    Description

      The call to dnAddress.getHostName() can return an IP address encoded as a string, which is then rejected because unresolved addresses can result in performance impacts due to repetitive DNS lookups later.  We can detect when this situation occurs, and perform a DNS reverse name lookup to fix the issue.

      Bouncing a DataNode in a managed environment results in a new IP address allocation, and the new instance fails to register with the NameNode.

      Attachments

        Issue Links

          Activity

            People

              svaughan Steve Vaughan
              svaughan Steve Vaughan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: