Uploaded image for project: 'Apache Cassandra'
  1. Apache Cassandra
  2. CASSANDRA-8192

Better error logging on corrupt compressed SSTables: currently AssertionError in Memory.java

    XMLWordPrintableJSON

Details

    Description

      Since update of 1 of 12 nodes from 2.1.0-rel to 2.1.1-rel Exception during start up.

      system.log

      ERROR [SSTableBatchOpen:1] 2014-10-27 09:44:00,079 CassandraDaemon.java:153 - Exception in thread Thread[SSTableBatchOpen:1,5,main]
      java.lang.AssertionError: null
      at org.apache.cassandra.io.util.Memory.size(Memory.java:307) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.compress.CompressionMetadata.<init>(CompressionMetadata.java:135) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.compress.CompressionMetadata.create(CompressionMetadata.java:83) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.util.CompressedSegmentedFile$Builder.metadata(CompressedSegmentedFile.java:50) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.util.CompressedPoolingSegmentedFile$Builder.complete(CompressedPoolingSegmentedFile.java:48) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:766) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:725) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:402) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:302) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at org.apache.cassandra.io.sstable.SSTableReader$4.run(SSTableReader.java:438) ~[apache-cassandra-2.1.1.jar:2.1.1]
      at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.7.0_55]
      at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_55]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.7.0_55]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.7.0_55]
      at java.lang.Thread.run(Unknown Source) [na:1.7.0_55]

      In the attached log you can still see as well CASSANDRA-8069 and CASSANDRA-6283.

      Attachments

        1. system-sstable_activity-jb-25-Filter.zip
          2 kB
          Andreas Schnitzerling
        2. system-compactions_in_progress-ka-47594-CompressionInfo.zip
          4 kB
          Andreas Schnitzerling
        3. system.log
          1.25 MB
          Andreas Schnitzerling
        4. system_AssertionTest.log
          20 kB
          Andreas Schnitzerling
        5. printChunkOffsetErrors.txt
          2 kB
          Joshua McKenzie
        6. logdata-onlinedata-ka-196504-CompressionInfo.zip
          0.2 kB
          Andreas Schnitzerling
        7. cassandra.yaml
          34 kB
          Andreas Schnitzerling
        8. cassandra.bat
          4 kB
          Andreas Schnitzerling
        9. 8192_v2.txt
          0.9 kB
          Joshua McKenzie
        10. 8192_v1.txt
          0.7 kB
          Joshua McKenzie

        Issue Links

          Activity

            People

              JoshuaMcKenzie Joshua McKenzie
              Andie78 Andreas Schnitzerling
              Joshua McKenzie
              Marcus Eriksson
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: