Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17151

upgrade jetty to 9.4.21

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 3.3.0
    • Fix Version/s: None
    • Component/s: kms
    • Labels:
      None
    • Target Version/s:

      Description

      I have tried to configure and start Hadoop KMS service, it was failed to start the error log messages:

      2020-07-23 10:57:31,872 INFO  Server - jetty-9.4.20.v20190813; built: 2019-08-13T21:28:18.144Z; git: 84700530e645e812b336747464d6fbbf370c9a20; jvm 1.8.0_252-8u252-b09-1~18.04-b09
      2020-07-23 10:57:31,899 INFO  session - DefaultSessionIdManager workerName=node0
      2020-07-23 10:57:31,899 INFO  session - No SessionScavenger set, using defaults
      2020-07-23 10:57:31,901 INFO  session - node0 Scavenging every 660000ms
      2020-07-23 10:57:31,912 INFO  ContextHandler - Started o.e.j.s.ServletContextHandler@5bf0d49{logs,/logs,file:///opt/hadoop-3.4.0-SNAPSHOT/logs/,AVAILABLE}
      2020-07-23 10:57:31,913 INFO  ContextHandler - Started o.e.j.s.ServletContextHandler@7c7a06ec{static,/static,jar:file:/opt/hadoop-3.4.0-SNAPSHOT/share/hadoop/common/hadoop-kms-3.4.0-SNAPSHOT.jar!/webapps/static,AVAILABLE}
      2020-07-23 10:57:31,986 INFO  TypeUtil - JVM Runtime does not support Modules
      2020-07-23 10:57:32,015 INFO  KMSWebApp - -------------------------------------------------------------
      2020-07-23 10:57:32,015 INFO  KMSWebApp -   Java runtime version : 1.8.0_252-8u252-b09-1~18.04-b09
      2020-07-23 10:57:32,015 INFO  KMSWebApp -   User: hadoop
      2020-07-23 10:57:32,015 INFO  KMSWebApp -   KMS Hadoop Version: 3.4.0-SNAPSHOT
      2020-07-23 10:57:32,015 INFO  KMSWebApp - -------------------------------------------------------------
      2020-07-23 10:57:32,023 INFO  KMSACLs - 'CREATE' ACL '*'
      2020-07-23 10:57:32,024 INFO  KMSACLs - 'DELETE' ACL '*'
      2020-07-23 10:57:32,024 INFO  KMSACLs - 'ROLLOVER' ACL '*'
      2020-07-23 10:57:32,024 INFO  KMSACLs - 'GET' ACL '*'
      2020-07-23 10:57:32,024 INFO  KMSACLs - 'GET_KEYS' ACL '*'
      2020-07-23 10:57:32,024 INFO  KMSACLs - 'GET_METADATA' ACL '*'
      2020-07-23 10:57:32,024 INFO  KMSACLs - 'SET_KEY_MATERIAL' ACL '*'
      2020-07-23 10:57:32,024 INFO  KMSACLs - 'GENERATE_EEK' ACL '*'
      2020-07-23 10:57:32,024 INFO  KMSACLs - 'DECRYPT_EEK' ACL '*'
      2020-07-23 10:57:32,025 INFO  KMSACLs - default.key.acl. for KEY_OP 'READ' is set to '*'
      2020-07-23 10:57:32,025 INFO  KMSACLs - default.key.acl. for KEY_OP 'MANAGEMENT' is set to '*'
      2020-07-23 10:57:32,025 INFO  KMSACLs - default.key.acl. for KEY_OP 'GENERATE_EEK' is set to '*'
      2020-07-23 10:57:32,025 INFO  KMSACLs - default.key.acl. for KEY_OP 'DECRYPT_EEK' is set to '*'
      2020-07-23 10:57:32,080 INFO  KMSAudit - Initializing audit logger class org.apache.hadoop.crypto.key.kms.server.SimpleKMSAuditLogger
      2020-07-23 10:57:32,537 INFO  KMSWebServer - SHUTDOWN_MSG:
      /************************************************************
      SHUTDOWN_MSG: Shutting down KMSWebServer at hadoop-benchmark/172.17.0.2

      I have googled the error and found there is a simlar issue: https://github.com/eclipse/jetty.project/issues/4064

      It looks like a bug of jetty and has  been fixed in jetty>=9.4.21, currently Hadoop use the jetty is version of 9.4.20, see hadoop-project/pom.xml.

        Attachments

        1. HADOOP-17151.001.patch
          0.6 kB
          liusheng

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                seanlau liusheng
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: