Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-8192

Better error logging on corrupt compressed SSTables: currently AssertionError in Memory.java

    XMLWordPrintableJSON

    Details

      Description

      Since update of 1 of 12 nodes from 2.1.0-rel to 2.1.1-rel Exception during start up.

      system.log

      ERROR [SSTableBatchOpen:1] 2014-10-27 09:44:00,079 CassandraDaemon.java:153 - Exception in thread Thread[SSTableBatchOpen:1,5,main]
      java.lang.AssertionError: null
      at org.apache.cassandra.io.util.Memory.size(Memory.java:307) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.compress.CompressionMetadata.<init>(CompressionMetadata.java:135) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.compress.CompressionMetadata.create(CompressionMetadata.java:83) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.util.CompressedSegmentedFile$Builder.metadata(CompressedSegmentedFile.java:50) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.util.CompressedPoolingSegmentedFile$Builder.complete(CompressedPoolingSegmentedFile.java:48) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:766) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:725) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:402) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:302) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader$4.run(SSTableReader.java:438) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.7.0_55]
      at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_55]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.7.0_55]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.7.0_55]
      at java.lang.Thread.run(Unknown Source) [na:1.7.0_55]

      In the attached log you can still see as well CASSANDRA-8069 and CASSANDRA-6283.

        Attachments

        1. 8192_v1.txt
          0.7 kB
          Joshua McKenzie
        2. 8192_v2.txt
          0.9 kB
          Joshua McKenzie
        3. cassandra.bat
          4 kB
          Andreas Schnitzerling
        4. cassandra.yaml
          34 kB
          Andreas Schnitzerling
        5. logdata-onlinedata-ka-196504-CompressionInfo.zip
          0.2 kB
          Andreas Schnitzerling
        6. printChunkOffsetErrors.txt
          2 kB
          Joshua McKenzie
        7. system_AssertionTest.log
          20 kB
          Andreas Schnitzerling
        8. system.log
          1.25 MB
          Andreas Schnitzerling
        9. system-compactions_in_progress-ka-47594-CompressionInfo.zip
          4 kB
          Andreas Schnitzerling
        10. system-sstable_activity-jb-25-Filter.zip
          2 kB
          Andreas Schnitzerling

          Issue Links

            Activity

              People

              • Assignee:
                JoshuaMcKenzie Joshua McKenzie
                Reporter:
                Andie78 Andreas Schnitzerling
                Authors:
                Joshua McKenzie
                Reviewers:
                Marcus Eriksson
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: