[KYLIN-5063] Kylin 4.0.0-Beta with Spark 3.1.2 & Hadoop 3.3.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: v4.0.0-beta
• Fix Version/s: v4.1.0
• Component/s: Integration
• Environment: Kylin 4.0.0-beta / Spark 3.1.2 / Hadoop 3.3.0
• Docs Text: http://kylin.apache.org/download/
• Skill Level: Don't Know (Unsure) - The default level

Language

English French

• Assignee: Unassigned
• Reporter: Eliott BAUDOT
• Created: 17/Aug/21 09:22
• Updated: 31/Aug/22 12:03

Description

Hi,

On a specific platform integration for a solution, we are using Spark 3.1.2 with Hadoop 3.3.0.

The installation of Kylin 4.0.0-beta was well installed and executed, but when we tried to start the application using "kylin.sh start", the following error message appeared into kylin.out :
 
org.apache.catalina.LifecycleException: Failed to start component [StandardEngine[Catalina].StandardHost[localhost].StandardContext[/kylin]]
at org.apache.catalina.util.LifecycleBase.handleSubClassException(LifecycleBase.java:440)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:198)
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:1016)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:992)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:639)
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1127)
at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:2020)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: Unable to find ServletContextHandler for provided ServletContext
at org.eclipse.jetty.websocket.server.NativeWebSocketServletContainerInitializer.onStartup(NativeWebSocketServletContainerInitializer.java:120)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5709)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
... 10 more
Aug 06, 2021 7:42:49 AM org.apache.catalina.startup.HostConfig deployWAR
SEVERE: Error deploying web application archive [/opt/apache-kylin-4.0.0-beta-bin/tomcat/webapps/kylin.war]
java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: Failed to start component [StandardEngine[Catalina].StandardHost[localhost].StandardContext[/kylin]]
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:1020)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:992)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:639)
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1127)
at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:2020)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
 
 
Do you know why ? How can we solve it ?

Is there an issue on our installation ?

Are there some patches / workarounds / or Kylin upgrades to take in account to fix this blocking issue to use Kylin on this specific environnement ?

Are there some incompatabilities between the products release 4.0.0-beta / Spark 3.1.2 / Hadoop 3.3.0 ?

Thanks in advance, for yours ideas, help or support.