Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-14895

SSTable loader exception when loading 3.0/3.11 compact tables into 4.0

    XMLWordPrintableJSON

    Details

    • Severity:
      Critical

      Description

      While working on the upgrade tests I added 3.0/3.11 to current tests for loading old version sstables using sstable loader. The tests for loading compact sstables fail.

      It doesn't help to alter the table to drop compact storage and then run rebuild and cleanup before attempting to load into current.

      Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
      java.lang.RuntimeException: Unknown column value during deserialization
      java.lang.RuntimeException: Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:77)
      at org.apache.cassandra.db.lifecycle.LifecycleTransaction.getFiles(LifecycleTransaction.java:561)
      at org.apache.cassandra.io.sstable.SSTableLoader.openSSTables(SSTableLoader.java:76)
      at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:166)
      at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:83)
      at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:49)
      Caused by: java.lang.RuntimeException: Unknown column value during deserialization
      at org.apache.cassandra.db.SerializationHeader$Component.toHeader(SerializationHeader.java:317)
      at org.apache.cassandra.io.sstable.format.SSTableReader.openForBatch(SSTableReader.java:440)
      at org.apache.cassandra.io.sstable.SSTableLoader.lambda$openSSTables$0(SSTableLoader.java:121)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.lambda$innerList$2(LogAwareFileLister.java:99)
      at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
      at java.util.TreeMap$EntrySpliterator.forEachRemaining(TreeMap.java:2969)
      at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
      at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
      at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
      at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
      at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.innerList(LogAwareFileLister.java:101)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:73)
      ... 5 more
      Exception in thread "main" org.apache.cassandra.tools.BulkLoadException: java.lang.RuntimeException: Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
      at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:96)
      at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:49)
      Caused by: java.lang.RuntimeException: Failed to list files in /var/folders/vx/2fcrbbx12g9bppxk7h41ww700000gn/T/dtest-4_4vb5jj/test/node1/data1_copy/ks/counter1-f4dc7fc0e91011e892e9c3e97b26557e
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:77)
      at org.apache.cassandra.db.lifecycle.LifecycleTransaction.getFiles(LifecycleTransaction.java:561)
      at org.apache.cassandra.io.sstable.SSTableLoader.openSSTables(SSTableLoader.java:76)
      at org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:166)
      at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:83)
      ... 1 more
      Caused by: java.lang.RuntimeException: Unknown column value during deserialization
      at org.apache.cassandra.db.SerializationHeader$Component.toHeader(SerializationHeader.java:317)
      at org.apache.cassandra.io.sstable.format.SSTableReader.openForBatch(SSTableReader.java:440)
      at org.apache.cassandra.io.sstable.SSTableLoader.lambda$openSSTables$0(SSTableLoader.java:121)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.lambda$innerList$2(LogAwareFileLister.java:99)
      at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
      at java.util.TreeMap$EntrySpliterator.forEachRemaining(TreeMap.java:2969)
      at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
      at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
      at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
      at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
      at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.innerList(LogAwareFileLister.java:101)
      at org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:73)
      ... 5 more

        Attachments

          Activity

            People

            • Assignee:
              djoshi3 Dinesh Joshi
              Reporter:
              aweisberg Ariel Weisberg
              Authors:
              Dinesh Joshi
              Reviewers:
              Ariel Weisberg
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: