20/07/28 13:33:27 WARN util.Utils: Your hostname, Lakshminarayans-MacBook-Pro.local resolves to a loopback address: 127.0.0.1; using 10.0.0.136 instead (on interface en0) 20/07/28 13:33:27 WARN util.Utils: Set SPARK_LOCAL_IP if you need to bind to another address 20/07/28 13:33:27 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 20/07/28 13:33:27 INFO driver.RSCDriver: Connecting to: 10.0.0.136:10000 20/07/28 13:33:27 INFO driver.RSCDriver: Starting RPC server... 20/07/28 13:33:27 INFO rpc.RpcServer: Connected to the port 10001 20/07/28 13:33:27 WARN rsc.RSCConf: Your hostname, Lakshminarayans-MacBook-Pro.local, resolves to a loopback address; using 10.0.0.136 instead (on interface en0) 20/07/28 13:33:27 WARN rsc.RSCConf: Set 'livy.rsc.rpc.server.address' if you need to bind to another address. 20/07/28 13:33:28 INFO rpc.Rpc$SaslClientHandler: Exception in SASL negotiation. java.lang.IncompatibleClassChangeError: Found interface org.objectweb.asm.MethodVisitor, but class was expected at org.apache.livy.shaded.kryo.reflectasm.ConstructorAccess.insertConstructor(ConstructorAccess.java:128) at org.apache.livy.shaded.kryo.reflectasm.ConstructorAccess.get(ConstructorAccess.java:98) at org.apache.livy.shaded.kryo.kryo.Kryo$DefaultInstantiatorStrategy.newInstantiatorOf(Kryo.java:1271) at org.apache.livy.shaded.kryo.kryo.Kryo.newInstantiator(Kryo.java:1127) at org.apache.livy.shaded.kryo.kryo.Kryo.newInstance(Kryo.java:1136) at org.apache.livy.shaded.kryo.kryo.serializers.FieldSerializer.create(FieldSerializer.java:562) at org.apache.livy.shaded.kryo.kryo.serializers.FieldSerializer.read(FieldSerializer.java:538) at org.apache.livy.shaded.kryo.kryo.Kryo.readClassAndObject(Kryo.java:813) at org.apache.livy.client.common.Serializer.deserialize(Serializer.java:67) at org.apache.livy.rsc.rpc.KryoMessageCodec.decode(KryoMessageCodec.java:70) at io.netty.handler.codec.ByteToMessageCodec$1.decode(ByteToMessageCodec.java:42) at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283) at io.netty.handler.codec.ByteToMessageCodec.channelRead(ByteToMessageCodec.java:103) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at java.lang.Thread.run(Thread.java:748) 20/07/28 13:33:28 WARN channel.DefaultChannelPipeline: An exceptionCaught() event was fired, and it reached at the tail of the pipeline. It usually means the last handler in the pipeline did not handle the exception. java.lang.IncompatibleClassChangeError: Found interface org.objectweb.asm.MethodVisitor, but class was expected at org.apache.livy.shaded.kryo.reflectasm.ConstructorAccess.insertConstructor(ConstructorAccess.java:128) at org.apache.livy.shaded.kryo.reflectasm.ConstructorAccess.get(ConstructorAccess.java:98) at org.apache.livy.shaded.kryo.kryo.Kryo$DefaultInstantiatorStrategy.newInstantiatorOf(Kryo.java:1271) at org.apache.livy.shaded.kryo.kryo.Kryo.newInstantiator(Kryo.java:1127) at org.apache.livy.shaded.kryo.kryo.Kryo.newInstance(Kryo.java:1136) at org.apache.livy.shaded.kryo.kryo.serializers.FieldSerializer.create(FieldSerializer.java:562) at org.apache.livy.shaded.kryo.kryo.serializers.FieldSerializer.read(FieldSerializer.java:538) at org.apache.livy.shaded.kryo.kryo.Kryo.readClassAndObject(Kryo.java:813) at org.apache.livy.client.common.Serializer.deserialize(Serializer.java:67) at org.apache.livy.rsc.rpc.KryoMessageCodec.decode(KryoMessageCodec.java:70) at io.netty.handler.codec.ByteToMessageCodec$1.decode(ByteToMessageCodec.java:42) at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283) at io.netty.handler.codec.ByteToMessageCodec.channelRead(ByteToMessageCodec.java:103) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at java.lang.Thread.run(Thread.java:748) Exception in thread "main" java.util.concurrent.ExecutionException: java.lang.IncompatibleClassChangeError: Found interface org.objectweb.asm.MethodVisitor, but class was expected at io.netty.util.concurrent.DefaultPromise.get(DefaultPromise.java:349) at org.apache.livy.rsc.driver.RSCDriver.initializeServer(RSCDriver.java:203) at org.apache.livy.rsc.driver.RSCDriver.run(RSCDriver.java:336) at org.apache.livy.rsc.driver.RSCDriverBootstrapper.main(RSCDriverBootstrapper.java:93) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Caused by: java.lang.IncompatibleClassChangeError: Found interface org.objectweb.asm.MethodVisitor, but class was expected at org.apache.livy.shaded.kryo.reflectasm.ConstructorAccess.insertConstructor(ConstructorAccess.java:128) at org.apache.livy.shaded.kryo.reflectasm.ConstructorAccess.get(ConstructorAccess.java:98) at org.apache.livy.shaded.kryo.kryo.Kryo$DefaultInstantiatorStrategy.newInstantiatorOf(Kryo.java:1271) at org.apache.livy.shaded.kryo.kryo.Kryo.newInstantiator(Kryo.java:1127) at org.apache.livy.shaded.kryo.kryo.Kryo.newInstance(Kryo.java:1136) at org.apache.livy.shaded.kryo.kryo.serializers.FieldSerializer.create(FieldSerializer.java:562) at org.apache.livy.shaded.kryo.kryo.serializers.FieldSerializer.read(FieldSerializer.java:538) at org.apache.livy.shaded.kryo.kryo.Kryo.readClassAndObject(Kryo.java:813) at org.apache.livy.client.common.Serializer.deserialize(Serializer.java:67) at org.apache.livy.rsc.rpc.KryoMessageCodec.decode(KryoMessageCodec.java:70) at io.netty.handler.codec.ByteToMessageCodec$1.decode(ByteToMessageCodec.java:42) at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:505) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:444) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:283) at io.netty.handler.codec.ByteToMessageCodec.channelRead(ByteToMessageCodec.java:103) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at java.lang.Thread.run(Thread.java:748) 20/07/28 13:33:28 INFO util.ShutdownHookManager: Shutdown hook called 20/07/28 13:33:28 INFO util.ShutdownHookManager: Deleting directory /private/var/folders/8f/4xq53xxd4tzg5rb4ccrwfwpc0000gn/T/spark-eed79843-fbd5-47e6-b990-5127391d9c94