[CASSANDRA-8314] C* 2.1.1: AssertionError: "stream can only read forward"

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Cannot Reproduce
• Severity: Normal
• Assignee: Unassigned
• Reporter: Donald Smith
• Created: 13/Nov/14 23:15
• Updated: 16/Apr/19 09:31
• Resolved: 17/Sep/15 16:18

Description

I see this multiple nodes on a 2.1.1 cluster running on CentOS 6.4:

ERROR [STREAM-IN-/10.6.1.104] 2014-11-13 14:13:16,565 StreamSession.java (line 470) [Stream #45bdfe30-6b81-11e4-a7ca-b150b4554347] Streaming error occurred
java.io.IOException: Too many retries for Header (cfId: aaefa7d7-9d72-3d18-b5f0-02b30cee5bd7, #29, version: jb, estimated keys: 12672, transfer size: 130005779, compressed?: true, repairedAt: 0)
        at org.apache.cassandra.streaming.StreamSession.doRetry(StreamSession.java:594) [apache-cassandra-2.1.1.jar:2.1.1]
        at org.apache.cassandra.streaming.messages.IncomingFileMessage$1.deserialize(IncomingFileMessage.java:53) [apache-cassandra-2.1.1.jar:2.1.1]
        at org.apache.cassandra.streaming.messages.IncomingFileMessage$1.deserialize(IncomingFileMessage.java:38) [apache-cassandra-2.1.1.jar:2.1.1]
        at org.apache.cassandra.streaming.messages.StreamMessage.deserialize(StreamMessage.java:55) [apache-cassandra-2.1.1.jar:2.1.1]
        at org.apache.cassandra.streaming.ConnectionHandler$IncomingMessageHandler.run(ConnectionHandler.java:245) [apache-cassandra-2.1.1.jar:2.1.1]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60]
Caused by: java.lang.AssertionError: stream can only read forward.
        at org.apache.cassandra.streaming.compress.CompressedInputStream.position(CompressedInputStream.java:107) ~[apache-cassandra-2.1.1.jar:2.1.1]
        at org.apache.cassandra.streaming.compress.CompressedStreamReader.read(CompressedStreamReader.java:85) ~[apache-cassandra-2.1.1.jar:2.1.1]
        at org.apache.cassandra.streaming.messages.IncomingFileMessage$1.deserialize(IncomingFileMessage.java:48) [apache-cassandra-2.1.1.jar:2.1.1]
        ... 4 common frames omitted

We couldn't upgrade SStables due to exceptions.

Issue Links

• relates to: CASSANDRA-8310 Assertion error in 2.1.1: SSTableReader.cloneWithNewSummarySamplingLevel(SSTableReader.java:988)
• relates to: CASSANDRA-8311 C* 2.1.1: AssertionError in AbstractionCompactionTask "not correctly marked compacting"