[CASSANDRA-3521] sstableloader throwing exceptions when loading snapshot data from compressed CFs

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 1.0.4
• Labels: compression

Environment

One node cluster (same problem with 4 nodes ) and dedicated machine for sstable loader.
node and loader running jdk1.6.0_29 and cassandra-1.0.3

• Severity: Normal
• Assignee: Yuki Morishita
• Reporter: Peter Velas

Authors

Yuki Morishita

Reviewers

Sylvain Lebresne

• Created: 22/Nov/11 09:33
• Updated: 16/Apr/19 09:32
• Resolved: 25/Nov/11 09:20

Description

Loaded data from snapshot then enabled `sstable_compression: org.apache.cassandra.io.compress.SnappyCompressor`
Then flush, scrub and compact. I can see actual CompressionRatio in JMX Console and access my data without problems..

Now I snapshot compressed keyspace and when trying to load snapshot to another single node or different Keyspace (the same super CF structure with compression options enabled, even try to truncate snapshoted CFs.) I cant retrieve any records .

sstableloader command with debug mode dont throw any errors and shows its streaming

sstableloader-cassandra_2/bin/sstableloader --debug Impressions_compressed/

Node logs contains repeating the errors bellow.

ERROR [Thread-319] 2011-11-22 09:56:01,931 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-319,5,main]
java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-260-Data.db
at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
INFO [Thread-320] 2011-11-22 09:56:02,492 StreamInSession.java (line 120) Streaming of file Impressions_compressed/HidSaid-hb-9-Data.db sections=1 progress=0/5616749 - 0% from org.apache.cassandra.streaming.StreamInSession@3cc62c07 failed: requesting a retry.
ERROR [Thread-320] 2011-11-22 09:56:02,493 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-320,5,main]
java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-261-Data.db
at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)

Hope its enough if you need more info just tell me what you need to reproduce this bug.