[TWILL-262] YarnUtils#cloneHaNnCredentials uses DFSUtil#getHaNnRpcAddresses, which is removed from DFSUtils from hadoop-2.8

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0, 0.9.0, 0.11.0, 0.12.0, 0.13.0
• Fix Version/s: 0.14.0
• Component/s: yarn
• Assignee: Hongyuan Li
• Reporter: Hongyuan Li
• Created: 29/Sep/18 06:21
• Updated: 13/Dec/18 01:23
• Resolved: 12/Dec/18 18:41

Description

YarnUtils#cloneHaNnCredentials uses DFSUtil#getHaNnRpcAddresses, which is removed from DFSUtils from hadoop-2.8

current code

  public static void cloneHaNnCredentials(Configuration config) throws IOException {
    ……

    // Loop through all name services. Each name service could have multiple name node associated with it.
    for (Map.Entry<String, Map<String, InetSocketAddress>> entry : DFSUtil.getHaNnRpcAddresses(config).entrySet()) {
      String nsId = entry.getKey();
      Map<String, InetSocketAddress> addressesInNN = entry.getValue();
      if (!HAUtil.isHAEnabled(config, nsId) || addressesInNN == null || addressesInNN.isEmpty()) {
        continue;
      }

 ……
  }

Issue Links

• links to: GitHub Pull Request #71