Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-7268

Secondary Index can miss data without an error

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Severity:
      Normal

      Description

      Seeing issues with secondary indexes after upgrading from 1.1->1.2. Using the same thrift code from 1.1, every once in a while a row is inserted that does not show up in the secondary index on a text column.

      Using sstable2json we can see the row in the regular sstables on every node, but not in the secondary index sstables (even after flushing/taking a snapshot).

      If we move the snapshot to a test node and rebuild the secondary index, it gets populated correctly and returns the data.

      Sanitized create statement:

      create column family test2i 
      with column_type = 'Standard' 
      and comparator = 'UTF8Type' 
      and default_validation_class = 'UTF8Type' 
      and key_validation_class = 'UTF8Type' 
      and read_repair_chance = 1.0 
      and dclocal_read_repair_chance = 0.0 
      and populate_io_cache_on_flush = false 
      and gc_grace = 0 
      and min_compaction_threshold = 4 
      and max_compaction_threshold = 32 
      and replicate_on_write = false 
      and compaction_strategy = 'org.apache.cassandra.db.compaction.LeveledCompactionStrategy' 
      and caching = 'KEYS_ONLY' 
      and column_metadata = [ 
      {column_name : 'second', 
      validation_class : UTF8Type, 
      index_name : 'test2i_second_idx', 
      index_type : 0}, 
      {column_name : 'A', 
      validation_class : UTF8Type}, 
      {column_name : 'B', 
      validation_class : UTF8Type}, 
      {column_name : 'C', 
      validation_class : UTF8Type}, 
      {column_name : 'D', 
      validation_class : UTF8Type}, 
      {column_name : 'E', 
      validation_class : UTF8Type}, 
      {column_name : 'F', 
      validation_class : UTF8Type}, 
      {column_name : 'G', 
      validation_class : UTF8Type}, 
      {column_name : 'H', 
      validation_class : UTF8Type}, 
      {column_name : 'I', 
      validation_class : UTF8Type}, 
      {column_name : 'J', 
      validation_class : UTF8Type}, 
      {column_name : 'K', 
      validation_class : UTF8Type}, 
      {column_name : 'L', 
      validation_class : UTF8Type}, 
      {column_name : 'M', 
      validation_class : UTF8Type}] 
      and compression_options = {'sstable_compression' : 'org.apache.cassandra.io.compress.SnappyCompressor'};
      

        Attachments

        1. 7268-1.2.txt
          7 kB
          Sam Tunnicliffe
        2. 7268-2.0.txt
          7 kB
          Sam Tunnicliffe
        3. 7268-2.1.txt
          7 kB
          Sam Tunnicliffe

          Activity

            People

            • Assignee:
              samt Sam Tunnicliffe Assign to me
              Reporter:
              jjordan Jeremiah Jordan
              Authors:
              Sam Tunnicliffe
              Reviewers:
              Aleksey Yeschenko

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment