[HDFS-10544] Balancer doesn't work with IPFailoverProxyProvider

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.1
• Fix Version/s: 2.8.0, 2.6.5, 2.7.4, 3.0.0-alpha1
• Component/s: balancer & mover, ha
• Target Version/s: 2.6.5
• Hadoop Flags: Reviewed
• Assignee: Zhe Zhang
• Reporter: Zhe Zhang
• Created: 17/Jun/16 18:11
• Updated: 06/Jan/17 08:02
• Resolved: 13/Jul/16 21:57

Description

Right now Balancer gets the NN URIs through DFSUtil#getNameServiceUris, which returns logical URIs in HA is enabled. If IPFailoverProxyProvider is used, Balancer will not be able to start.

I think the bug is at DFSUtil#getNameServiceUris:

    for (String nsId : getNameServiceIds(conf)) {
      if (HAUtil.isHAEnabled(conf, nsId)) {
        // Add the logical URI of the nameservice.
        try {
          ret.add(new URI(HdfsConstants.HDFS_URI_SCHEME + "://" + nsId));

Then if clause should also consider if the FailoverProxyProvider has useLogicalURI enabled. If not, getNameServiceUris should try to resolve the physical URI for this nsId.