[CASSANDRA-10940] sstableloader shuold skip streaming SSTable generated in < 3.0.0

• Type: Bug
• Status: Resolved
• Priority: Low
• Resolution: Won't Fix
• Fix Version/s: 3.0.5, 3.11.5
• Component/s: Legacy/Streaming and Messaging, Legacy/Tools
• Severity: Low
• Assignee: Yuki Morishita
• Reporter: Yuki Morishita

Authors

Yuki Morishita

Reviewers

Paulo Motta

• Created: 24/Dec/15 22:51
• Updated: 01/Aug/21 12:40
• Resolved: 15/Mar/16 16:05

Description

Since 3.0.0, streaming does not support SSTable from version less than 3.0.0.

sstableloader should skip those files to be streamed, instead of erroring out like below:

Failed to list files in /home/yuki/.ccm/2.1.11/node1/data/keyspace1/standard1-5242ae50a9b311e585b29dc952593398
java.lang.NullPointerException
java.lang.RuntimeException: Failed to list files in /home/yuki/.ccm/2.1.11/node1/data/keyspace1/standard1-5242ae50a9b311e585b29dc952593398
        at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:53)
        at org.apache.cassandra.db.lifecycle.LifecycleTransaction.getFiles(LifecycleTransaction.java:544)
        at org.apache.cassandra.io.sstable.SSTableLoader.openSSTables(SSTableLoader.java:76)
        at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:165)
        at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:101)
Caused by: java.lang.NullPointerException
        at org.apache.cassandra.io.sstable.format.SSTableReader.openForBatch(SSTableReader.java:421)
        at org.apache.cassandra.io.sstable.SSTableLoader.lambda$openSSTables$186(SSTableLoader.java:121)
        at org.apache.cassandra.io.sstable.SSTableLoader$$Lambda$18/712974096.apply(Unknown Source)
        at org.apache.cassandra.db.lifecycle.LogAwareFileLister.lambda$innerList$178(LogAwareFileLister.java:75)
        at org.apache.cassandra.db.lifecycle.LogAwareFileLister$$Lambda$29/1191654595.test(Unknown Source)
        at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
        at java.util.TreeMap$EntrySpliterator.forEachRemaining(TreeMap.java:2965)
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:512)
        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:502)
        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
        at org.apache.cassandra.db.lifecycle.LogAwareFileLister.innerList(LogAwareFileLister.java:77)
        at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:49)
        ... 4 more

Issue Links

• is superceded by: CASSANDRA-10990 Support streaming of older version sstables in 3.0