Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14845

Ignore AuthenticationFilterInitializer for HttpFSServerWebServer and honor hadoop.http.authentication configs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.3.0
    • Fix Version/s: 3.3.0
    • Component/s: httpfs
    • Labels:
      None
    • Environment:

      Kerberos and ZKDelgationTokenSecretManager enabled in HttpFS

    • Hadoop Flags:
      Reviewed
    • Release Note:
      httpfs.authentication.* configs become deprecated and hadoop.http.authentication.* configs are honored in HttpFS. If the both configs are set, httpfs.authentication.* configs are effective for compatibility.

      Description

      We are facing "Request is a replay (34)" error when accessing to HDFS via httpfs on trunk.

      % curl -i --negotiate -u : "https://<host>:4443/webhdfs/v1/?op=liststatus"
      HTTP/1.1 401 Authentication required
      Date: Mon, 09 Sep 2019 06:00:04 GMT
      Date: Mon, 09 Sep 2019 06:00:04 GMT
      Pragma: no-cache
      X-Content-Type-Options: nosniff
      X-XSS-Protection: 1; mode=block
      WWW-Authenticate: Negotiate
      Set-Cookie: hadoop.auth=; Path=/; Secure; HttpOnly
      Cache-Control: must-revalidate,no-cache,no-store
      Content-Type: text/html;charset=iso-8859-1
      Content-Length: 271
      
      HTTP/1.1 403 GSSException: Failure unspecified at GSS-API level (Mechanism level: Request is a replay (34))
      Date: Mon, 09 Sep 2019 06:00:04 GMT
      Date: Mon, 09 Sep 2019 06:00:04 GMT
      Pragma: no-cache
      X-Content-Type-Options: nosniff
      X-XSS-Protection: 1; mode=block
      (snip)
      Set-Cookie: hadoop.auth=; Path=/; Secure; HttpOnly
      Cache-Control: must-revalidate,no-cache,no-store
      Content-Type: text/html;charset=iso-8859-1
      Content-Length: 413
      
      <html>
      <head>
      <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
      <title>Error 403 GSSException: Failure unspecified at GSS-API level (Mechanism level: Request is a replay (34))</title>
      </head>
      <body><h2>HTTP ERROR 403</h2>
      <p>Problem accessing /webhdfs/v1/. Reason:
      <pre>    GSSException: Failure unspecified at GSS-API level (Mechanism level: Request is a replay (34))</pre></p>
      </body>
      </html>
      

        Attachments

        1. HDFS-14845-006.patch
          9 kB
          Prabhu Joseph
        2. HDFS-14845-005.patch
          8 kB
          Prabhu Joseph
        3. HDFS-14845-004.patch
          7 kB
          Prabhu Joseph
        4. HDFS-14845-003.patch
          6 kB
          Prabhu Joseph
        5. HDFS-14845-002.patch
          4 kB
          Prabhu Joseph
        6. HDFS-14845-001.patch
          2 kB
          Prabhu Joseph

          Issue Links

            Activity

              People

              • Assignee:
                prabhujoseph Prabhu Joseph
                Reporter:
                aajisaka Akira Ajisaka
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: