Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-3521

sstableloader throwing exceptions when loading snapshot data from compressed CFs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Normal
    • Resolution: Fixed
    • Fix Version/s: 1.0.4
    • Component/s: None
    • Labels:
    • Environment:

      One node cluster (same problem with 4 nodes ) and dedicated machine for sstable loader.
      node and loader running jdk1.6.0_29 and cassandra-1.0.3

    • Severity:
      Normal

      Description

      Loaded data from snapshot then enabled `sstable_compression: org.apache.cassandra.io.compress.SnappyCompressor`
      Then flush, scrub and compact. I can see actual CompressionRatio in JMX Console and access my data without problems..

      Now I snapshot compressed keyspace and when trying to load snapshot to another single node or different Keyspace (the same super CF structure with compression options enabled, even try to truncate snapshoted CFs.) I cant retrieve any records .

      sstableloader command with debug mode dont throw any errors and shows its streaming

      sstableloader-cassandra_2/bin/sstableloader --debug Impressions_compressed/

      Node logs contains repeating the errors bellow.

      ERROR [Thread-319] 2011-11-22 09:56:01,931 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-319,5,main]
      java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-260-Data.db
      at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
      at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
      at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
      at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
      at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
      INFO [Thread-320] 2011-11-22 09:56:02,492 StreamInSession.java (line 120) Streaming of file Impressions_compressed/HidSaid-hb-9-Data.db sections=1 progress=0/5616749 - 0% from org.apache.cassandra.streaming.StreamInSession@3cc62c07 failed: requesting a retry.
      ERROR [Thread-320] 2011-11-22 09:56:02,493 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[Thread-320,5,main]
      java.lang.AssertionError: attempted to delete non-existing file HidSaid-tmp-hb-261-Data.db
      at org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
      at org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
      at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
      at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
      at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)

      Hope its enough if you need more info just tell me what you need to reproduce this bug.

        Attachments

        1. 3521.txt
          0.7 kB
          Yuki Morishita

          Activity

            People

            • Assignee:
              yukim Yuki Morishita
              Reporter:
              pvelas Peter Velas
              Authors:
              Yuki Morishita
              Reviewers:
              Sylvain Lebresne
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: