[LIVY-371] share one livy-client to multiple user cause kryo problem

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.4.0
• Fix Version/s: 0.9.0
• Component/s: API, RSC
• Labels: crash
• Environment: spark 2.0.1 hbase 1.2.1 hadoop 2.7.3 livy 0.4.0
• Assignee: Unassigned
• Reporter: zzzhy
• Created: 16/Jun/17 11:43
• Updated: 12/Nov/22 22:10

Description

job run failed ,exception:Map(errorClass -> java.util.concurrent.ExecutionException, cause -> java.lang.RuntimeException: Parent scope can be set just once
com.cloudera.livy.shaded.kryo.kryo.Generics.setParentScope(Generics.java:53)
com.cloudera.livy.shaded.kryo.kryo.Kryo.pushGenericsScope(Kryo.java:1173)
com.cloudera.livy.shaded.kryo.kryo.serializers.FieldSerializer.write(FieldSerializer.java:469)
com.cloudera.livy.shaded.kryo.kryo.Kryo.writeClassAndObject(Kryo.java:614)
com.cloudera.livy.client.common.Serializer.serialize(Serializer.java:70)
com.cloudera.livy.rsc.driver.BypassJob.call(BypassJob.java:43)
com.cloudera.livy.rsc.driver.BypassJob.call(BypassJob.java:27)
com.cloudera.livy.rsc.driver.JobWrapper.call(JobWrapper.java:57)
com.cloudera.livy.rsc.driver.BypassJobWrapper.call(BypassJobWrapper.java:42)
com.cloudera.livy.rsc.driver.BypassJobWrapper.call(BypassJobWrapper.java:27)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
java.lang.Thread.run(Thread.java:745), stack -> WrappedArray(com.cloudera.livy.client.http.JobHandleImpl$JobPollTask.run(JobHandleImpl.java:248), java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511), java.util.concurrent.FutureTask.run(FutureTask.java:266), java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180), java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293), java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142), java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617), java.lang.Thread.run(Thread.java:745)), causingClass -> java.lang.RuntimeException, message -> java.lang.RuntimeException: java.lang.RuntimeException: Parent scope can be set just once
com.cloudera.livy.shaded.kryo.kryo.Generics.setParentScope(Generics.java:53)
com.cloudera.livy.shaded.kryo.kryo.Kryo.pushGenericsScope(Kryo.java:1173)
com.cloudera.livy.shaded.kryo.kryo.serializers.FieldSerializer.write(FieldSerializer.java:469)
com.cloudera.livy.shaded.kryo.kryo.Kryo.writeClassAndObject(Kryo.java:614)
com.cloudera.livy.client.common.Serializer.serialize(Serializer.java:70)
com.cloudera.livy.rsc.driver.BypassJob.call(BypassJob.java:43)
com.cloudera.livy.rsc.driver.BypassJob.call(BypassJob.java:27)
com.cloudera.livy.rsc.driver.JobWrapper.call(JobWrapper.java:57)
com.cloudera.livy.rsc.driver.BypassJobWrapper.call(BypassJobWrapper.java:42)
com.cloudera.livy.rsc.driver.BypassJobWrapper.call(BypassJobWrapper.java:27)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
java.lang.Thread.run(Thread.java:745))