Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8108

RM metrics rest API throws GSSException in kerberized environment

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 3.0.0
    • 3.2.0, 3.1.1, 3.3.0
    • None
    • None

    Description

      Test is trying to pull up metrics data from SHS after kiniting as 'test_user'

      It is throwing GSSException as follows

      b2b460b80713|RUNNING: curl --silent -k -X GET -D /hwqe/hadoopqe/artifacts/tmp-94845 --negotiate -u : http://rm_host:8088/proxy/application_1518674952153_0070/metrics/json2018-02-15 07:15:48,757|INFO|MainThread|machine.py:194 - run()||GUID=fc5a3266-28f8-4eed-bae2-b2b460b80713|Exit Code: 0
2018-02-15 07:15:48,758|INFO|MainThread|spark.py:1757 - getMetricsJsonData()|metrics:
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 403 GSSException: Failure unspecified at GSS-API level (Mechanism level: Request is a replay (34))</title>
</head>
<body><h2>HTTP ERROR 403</h2>
<p>Problem accessing /proxy/application_1518674952153_0070/metrics/json. Reason:
<pre> GSSException: Failure unspecified at GSS-API level (Mechanism level: Request is a replay (34))</pre></p>
</body>
</html>

      Rootcausing : proxyserver on RM can't be supported for Kerberos enabled cluster because AuthenticationFilter is applied twice in Hadoop code (once in httpServer2 for RM, and another instance from AmFilterInitializer for proxy server). This will require code changes to hadoop-yarn-server-web-proxy project

      Attachments

        1. YARN-8108.001.patch
          1 kB
          Eric Yang
        2. YARN-8108.002.patch
          4 kB
          Sunil G

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. YARN-8258 YARN webappcontext for UI2 should inherit all filters from default context

          • Major - Major loss of function.
          • Patch Available
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-15518 Authentication filter calling handler after request already authenticated

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              sunilg Sunil G
              kbadani Kshitij Badani
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: