[KYLIN-5073] kylin can't start because `Not running on Jetty, JSR-356 support unavailable`

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: v4.0.0
• Component/s: Client - CLI, Environment

Environment

[hadoop@node1 ~]$ lsb_release -a
LSB Version: :core-4.1-amd64:core-4.1-noarch:cxx-4.1-amd64:cxx-4.1-noarch:desktop-4.1-amd64:desktop-4.1-noarch:languages-4.1-amd64:languages-4.1-noarch:printing-4.1-amd64:printing-4.1-noarch
Distributor ID: CentOS
Description: CentOS Linux release 7.9.2009 (Core)
Release: 7.9.2009
Codename: Core


kylin's dependency version is :
hadoop-3.3.1
hive-3.1.2
kylin-4.0.0
spark-3.1.2-bin-hadoop3.2
zookeeper-3.7.0

[hadoop@node3 ~]$ java -version
openjdk version "1.8.0_302"
OpenJDK Runtime Environment (build 1.8.0_302-b08)
OpenJDK 64-Bit Server VM (build 25.302-b08, mixed mode)

the environment var is:
export ZK_HOME=/home/hadoop/zookeeper-3.7.0
export HADOOP_HOME=/home/hadoop/hadoop-3.3.1
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.302.b08-0.el7_9.x86_64/jre
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HIVE_HOME=/home/hadoop/hive-3.1.2
export SPARK_HOME=/home/hadoop/spark-3.1.2-bin-hadoop3.2
export KYLIN_HOME=/home/hadoop/kylin-4.0.0
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export CLASSPATH=$JAVA_HOME/lib:$($HADOOP_HOME/bin/hadoop classpath):$CLASSPATH
export PATH=$PATH:$ZK_HOME/bin:/usr/local/firefox:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin/:$SPARK_HOME/bin:$SPARK_HOME/sbin:$HIVE_HOME/bin

• Assignee: mukvin
• Reporter: 曹勇
• Created: 02/Sep/21 03:22
• Updated: 06/Sep/21 08:21

Description

I download Kylin4.0.0 for Apache Spark 3.1.1:

I edit the config:~/conf/kylin.properties:

//代码占位符kylin.metadata.url=kylin_metadata@jdbc,url=jdbc:mysql://10.110.147.229:3306/kylin,username=hadoop,password=hadoop1234,maxActive=10,maxIdle=10
kylin.env.zookeeper-connect-string=node2:2181,node3:2181,node4:2181

I run the script `kylin.sh start` to start kylin,it is ok.

//代码占位符
[hadoop@node3 bin]$ ./kylin.sh start
Retrieving hadoop conf dir...
...................................................[PASS]
KYLIN_HOME is set to /home/hadoop/kylin-4.0.0
Checking hive
...................................................[PASS]
Checking hadoop shell
...................................................[PASS]
Checking hdfs working dir
...................................................[PASS]
Checking environment finished successfully. To check again, run 'bin/check-env.sh' manually.
Retrieving hive dependency...
Retrieving hadoop conf dir...
Retrieving Spark dependency...
Skip spark which not owned by kylin. SPARK_HOME is /home/hadoop/spark-3.1.2-bin-hadoop3.2 and KYLIN_HOME is /home/hadoop/kylin-4.0.0 .
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
Start to check whether we need to migrate acl tables
Not HBase metadata. Skip check.
A new Kylin instance is started by hadoop. To stop it, run 'kylin.sh stop'
Check the log at /home/hadoop/kylin-4.0.0/logs/kylin.log
Web UI is at http://node3:7070/kylin

 

the error log is :

 

//代码占位符
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
九月 02, 2021 9:26:02 上午 org.apache.catalina.core.AprLifecycleListener lifecycleEvent
信息: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: [/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib]
九月 02, 2021 9:26:02 上午 org.apache.coyote.AbstractProtocol init
信息: 初始化协议处理器 ["http-bio-7070"]
九月 02, 2021 9:26:02 上午 org.apache.catalina.startup.Catalina load
信息: Initialization processed in 609 ms
九月 02, 2021 9:26:02 上午 org.apache.catalina.core.StandardService startInternal
信息: Starting service [Catalina]
九月 02, 2021 9:26:02 上午 org.apache.catalina.core.StandardEngine startInternal
信息: Starting Servlet Engine: Apache Tomcat/7.0.100
九月 02, 2021 9:26:02 上午 org.apache.catalina.startup.HostConfig deployWAR
信息: Deploying web application archive [/home/hadoop/kylin-4.0.0/tomcat/webapps/kylin.war]
ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Set system property 'log4j2.debug' to show Log4j2 internal initialization logging.
九月 02, 2021 9:26:03 上午 org.apache.catalina.core.StandardContext startInternal
严重: Error during ServletContainerInitializer processing
javax.servlet.ServletException: Not running on Jetty, JSR-356 support unavailable
        at org.eclipse.jetty.websocket.jsr356.server.deploy.WebSocketServerContainerInitializer.onStartup(WebSocketServerContainerInitializer.java:271)
        at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5709)
        at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:1016)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:992)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:639)
        at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1127)
        at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:2020)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)九月 02, 2021 9:26:03 上午 org.apache.catalina.core.StandardContext startInternal
严重: Context [/kylin] startup failed due to previous errors
九月 02, 2021 9:26:03 上午 org.apache.catalina.loader.WebappClassLoaderBase clearReferencesThreads
严重: The web application [/kylin] appears to have started a thread named [mysql-cj-abandoned-connection-cleanup] but has failed to stop it. This is very likely to create a memory leak.
九月 02, 2021 9:26:03 上午 org.apache.catalina.startup.HostConfig deployWAR
信息: Deployment of web application archive [/home/hadoop/kylin-4.0.0/tomcat/webapps/kylin.war] has finished in [928] ms
九月 02, 2021 9:26:03 上午 org.apache.coyote.AbstractProtocol start
信息: 开始协议处理句柄["http-bio-7070"]
九月 02, 2021 9:26:03 上午 org.apache.catalina.startup.Catalina start
信息: Server startup in 1011 ms
九月 02, 2021 9:26:08 上午 org.apache.catalina.loader.WebappClassLoaderBase findResourceInternal
信息: 非法访问：此Web应用程序实例已停止。无法加载[]。为了调试以及终止导致非法访问的线程，将抛出以下堆栈跟踪。

 

the port have been listened :

//代码占位符
[hadoop@node3 bin]$ jps
6288 JournalNode
17489 NodeManager
27940 ExecutorLauncher
2964 Bootstrap
3061 Jps
27318 DataNode
24956 QuorumPeerMain
28252 Worker
3582 YarnCoarseGrainedExecutorBackend
[hadoop@node3 bin]$ netstat -nplt|grep 2964
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
tcp6       0      0 :::7070                 :::*                    LISTEN      2964/java
tcp6       0      0 127.0.0.1:9005          :::*                    LISTEN      2964/java

But I can't visit the page through the url http://node3:7070/kylin.

It return 404

I wonder what going wrong.

 

Issue Links

• is related to: KYLIN-5069 Remove find-hive-dependency.sh in Kylin 4