Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8108

RM metrics rest API throws GSSException in kerberized environment

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.2.0, 3.1.1, 3.3.0
    • Component/s: None
    • Labels:
      None

      Description

      Test is trying to pull up metrics data from SHS after kiniting as 'test_user'

      It is throwing GSSException as follows

      b2b460b80713|RUNNING: curl --silent -k -X GET -D /hwqe/hadoopqe/artifacts/tmp-94845 --negotiate -u : http://rm_host:8088/proxy/application_1518674952153_0070/metrics/json2018-02-15 07:15:48,757|INFO|MainThread|machine.py:194 - run()||GUID=fc5a3266-28f8-4eed-bae2-b2b460b80713|Exit Code: 0
      2018-02-15 07:15:48,758|INFO|MainThread|spark.py:1757 - getMetricsJsonData()|metrics:
      <html>
      <head>
      <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
      <title>Error 403 GSSException: Failure unspecified at GSS-API level (Mechanism level: Request is a replay (34))</title>
      </head>
      <body><h2>HTTP ERROR 403</h2>
      <p>Problem accessing /proxy/application_1518674952153_0070/metrics/json. Reason:
      <pre> GSSException: Failure unspecified at GSS-API level (Mechanism level: Request is a replay (34))</pre></p>
      </body>
      </html>
      

      Rootcausing : proxyserver on RM can't be supported for Kerberos enabled cluster because AuthenticationFilter is applied twice in Hadoop code (once in httpServer2 for RM, and another instance from AmFilterInitializer for proxy server). This will require code changes to hadoop-yarn-server-web-proxy project

        Attachments

        1. YARN-8108.001.patch
          1 kB
          Eric Yang
        2. YARN-8108.002.patch
          4 kB
          Sunil Govindan

          Issue Links

            Activity

              People

              • Assignee:
                sunilg Sunil Govindan
                Reporter:
                kbadani Kshitij Badani
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: