[SPARK-31604] java.lang.IllegalArgumentException: Frame length should be positive

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Do
• Affects Version/s: 2.4.4
• Fix Version/s: 2.4.4
• Component/s: Deploy

Environment

Scala version 2.11.12

Spark version 2.4.4

• Target Version/s: 2.4.4
• Assignee: Unassigned
• Reporter: Divya Paliwal
• Created: 29/Apr/20 10:46
• Updated: 29/Apr/20 18:48
• Resolved: 29/Apr/20 18:48

Description

Hi,

I am currently facing the below error when I run my code to stream data from Couchbase in spark cluster.

2020-04-29 00:04:06,061 WARN server.TransportChannelHandler: Exception in connection from /[host]:56910 

java.lang.IllegalArgumentException: Frame length should be positive: -9223371863711366549
at org.spark_project.guava.base.Preconditions.checkArgument(Preconditions.java:119)
at org.apache.spark.network.util.TransportFrameDecoder.decodeNext(TransportFrameDecoder.java:134)
at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:81)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1359)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:935)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:138)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
at java.lang.Thread.run(Thread.java:748)

 

When ever I run the spark-submit command with all the arguments on the host I get the above error.

  

Thanks,

Divya