Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-3370

Deflate Compression corrupts SSTables

Agile BoardAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Normal
    • Resolution: Fixed
    • 1.0.1
    • None
    • Ubuntu Linux, amd64, Cassandra 1.0.0-rc2

    • Normal

    Description

      Hi,

      it seems that the Deflate Compressor corrupts the SSTables. 3 out of 3 Installations were corrupt. Snappy works fine.

      Here is what I did:

      1. Start a single cassandra node (I was using ByteOrderedPartitioner)
      2. Write data into cf that uses deflate compression - I think it has to be enough data so that the data folder contains some files.
      3. When I now try to read (I did a range scan) from my application, it fails and the logs show corruptions:

      Caused by: org.apache.cassandra.io.compress.CorruptedBlockException: (/home/cspriegel/Development/cassandra1/data/Test/Response-h-2-Data.db): corruption detected, chunk at 0 of length 65536.

      regards,
      Christian

      Attachments

        1. 3370.patch
          0.9 kB
          Sylvain Lebresne
        2. system.log
          23 kB
          Christian Spriegel
        3. Test.zip
          3 kB
          Christian Spriegel

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            slebresne Sylvain Lebresne Assign to me
            christianmovi Christian Spriegel
            Sylvain Lebresne
            Pavel Yaskevich
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment