Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-2897

Secondary indexes without read-before-write

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments



      Currently, secondary index updates require a read-before-write to maintain the index consistency. Keeping the index consistent at all time is not necessary however. We could let the (secondary) index get inconsistent on writes and repair those on reads. This would be easy because on reads, we make sure to request the indexed columns anyway, so we can just skip the row that are not needed and repair the index at the same time.

      This does trade work on writes for work on reads. However, read-before-write is sufficiently costly that it will likely be a win overall.

      There is (at least) two small technical difficulties here though:

      1. If we repair on read, this will be racy with writes, so we'll probably have to synchronize there.
      2. We probably shouldn't only rely on read to repair and we should also have a task to repair the index for things that are rarely read. It's unclear how to make that low impact though.


        1. 41ec9fc-2897.txt
          35 kB
          Philip Jenvey
        2. 2897-v4.txt
          83 kB
          Jonathan Ellis
        3. 2897-apply-cleanup.txt
          14 kB
          Jonathan Ellis
        4. 0003-CASSANDRA-2897.txt
          47 kB
          Sam Tunnicliffe
        5. 0002-CASSANDRA-2897-Secondary-indexes-without-read-before-w.txt
          53 kB
          Sam Tunnicliffe
        6. 0001-CASSANDRA-2897-Secondary-indexes-without-read-before-w.txt
          36 kB
          Sam Tunnicliffe

        Issue Links


          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users


            • Assignee:
              samt Sam Tunnicliffe Assign to me
              slebresne Sylvain Lebresne
              Sam Tunnicliffe
              Jonathan Ellis


              • Created:

                Issue deployment