Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9581

Fix WebAppUtils#getRMWebAppURLWithScheme ignores rm2

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0
    • 3.3.0, 3.2.1
    • client
    • None

    Description

      Yarn Logs fails for a running job in case of RM HA with rm2 active and rm1 is down.

      hrt_qa@prabhuYarn:~> /usr/hdp/current/hadoop-yarn-client/bin/yarn  logs -applicationId application_1558613472348_0004 -am 1
      19/05/24 18:04:49 INFO client.AHSProxy: Connecting to Application History server at prabhuYarn/172.27.23.55:10200
      19/05/24 18:04:50 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
      Unable to get AM container informations for the application:application_1558613472348_0004
      java.io.IOException: org.apache.hadoop.security.authentication.client.AuthenticationException: Error while authenticating with endpoint: https://prabhuYarn:8090/ws/v1/cluster/apps/application_1558613472348_0004/appattempts
      
      Can not get AMContainers logs for the application:application_1558613472348_0004 with the appOwner:hrt_qa
      

      LogsCli getRMWebAppURLWithoutScheme only checks the first one from the RM list yarn.resourcemanager.ha.rm-ids.

      yarnConfig.set(YarnConfiguration.RM_HA_ID, rmIds.get(0));
      

      SchedConfCli also fails

      [ambari-qa@pjosephdocker-3 ~]$ yarn  schedulerconf -update root.default:maximum-capacity=90
      Exception in thread "main" com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException: Connection refused (Connection refused)
      	at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155)
      	at com.sun.jersey.api.client.Client.handle(Client.java:652)
      	at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)
      

      Attachments

        1. YARN-9581.addendum-001.patch
          2 kB
          Prabhu Joseph
        2. YARN-9581-007.patch
          13 kB
          Prabhu Joseph
        3. YARN-9581-006.patch
          11 kB
          Prabhu Joseph
        4. YARN-9581-005.patch
          11 kB
          Prabhu Joseph
        5. YARN-9581-004.patch
          12 kB
          Prabhu Joseph
        6. YARN-9581-003.patch
          12 kB
          Prabhu Joseph
        7. YARN-9581-002.patch
          13 kB
          Prabhu Joseph
        8. YARN-9581-001.patch
          13 kB
          Prabhu Joseph

        Issue Links

          Activity

            People

              prabhujoseph Prabhu Joseph
              prabhujoseph Prabhu Joseph
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: