[YARN-9581] Fix WebAppUtils#getRMWebAppURLWithScheme ignores rm2

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.3.0, 3.2.1
• Component/s: client
• Assignee: Prabhu Joseph
• Reporter: Prabhu Joseph
• Created: 24/May/19 18:32
• Updated: 23/Oct/19 16:15
• Resolved: 28/Jun/19 18:57

Description

Yarn Logs fails for a running job in case of RM HA with rm2 active and rm1 is down.

hrt_qa@prabhuYarn:~> /usr/hdp/current/hadoop-yarn-client/bin/yarn  logs -applicationId application_1558613472348_0004 -am 1
19/05/24 18:04:49 INFO client.AHSProxy: Connecting to Application History server at prabhuYarn/172.27.23.55:10200
19/05/24 18:04:50 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
Unable to get AM container informations for the application:application_1558613472348_0004
java.io.IOException: org.apache.hadoop.security.authentication.client.AuthenticationException: Error while authenticating with endpoint: https://prabhuYarn:8090/ws/v1/cluster/apps/application_1558613472348_0004/appattempts

Can not get AMContainers logs for the application:application_1558613472348_0004 with the appOwner:hrt_qa

LogsCli getRMWebAppURLWithoutScheme only checks the first one from the RM list yarn.resourcemanager.ha.rm-ids.

yarnConfig.set(YarnConfiguration.RM_HA_ID, rmIds.get(0));

SchedConfCli also fails

[ambari-qa@pjosephdocker-3 ~]$ yarn  schedulerconf -update root.default:maximum-capacity=90
Exception in thread "main" com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException: Connection refused (Connection refused)
	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155)
	at com.sun.jersey.api.client.Client.handle(Client.java:652)
	at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)

Issue Links

• relates to: YARN-6270 WebUtils.getRMWebAppURLWithScheme() needs to honor RM HA setting