Uploaded image for project: 'Apache Cassandra'
  1. Apache Cassandra
  2. CASSANDRA-11163

Summaries are needlessly rebuilt when the BF FP ratio is changed

Agile BoardAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Normal

    Description

      This is from trunk, but I also saw this happen on 2.0:

      Before:

      root@bw-1:/srv/cassandra# ls -ltr /var/lib/cassandra/data/keyspace1/standard1-071efdc0d11811e590c3413ee28a6c90/
      total 221460
      drwxr-xr-x 2 root root      4096 Feb 11 23:34 backups
      -rw-r--r-- 1 root root        80 Feb 11 23:50 ma-6-big-TOC.txt
      -rw-r--r-- 1 root root     26518 Feb 11 23:50 ma-6-big-Summary.db
      -rw-r--r-- 1 root root     10264 Feb 11 23:50 ma-6-big-Statistics.db
      -rw-r--r-- 1 root root   2607705 Feb 11 23:50 ma-6-big-Index.db
      -rw-r--r-- 1 root root    192440 Feb 11 23:50 ma-6-big-Filter.db
      -rw-r--r-- 1 root root        10 Feb 11 23:50 ma-6-big-Digest.crc32
      -rw-r--r-- 1 root root  35212125 Feb 11 23:50 ma-6-big-Data.db
      -rw-r--r-- 1 root root      2156 Feb 11 23:50 ma-6-big-CRC.db
      -rw-r--r-- 1 root root        80 Feb 11 23:50 ma-7-big-TOC.txt
      -rw-r--r-- 1 root root     26518 Feb 11 23:50 ma-7-big-Summary.db
      -rw-r--r-- 1 root root     10264 Feb 11 23:50 ma-7-big-Statistics.db
      -rw-r--r-- 1 root root   2607614 Feb 11 23:50 ma-7-big-Index.db
      -rw-r--r-- 1 root root    192432 Feb 11 23:50 ma-7-big-Filter.db
      -rw-r--r-- 1 root root         9 Feb 11 23:50 ma-7-big-Digest.crc32
      -rw-r--r-- 1 root root  35190400 Feb 11 23:50 ma-7-big-Data.db
      -rw-r--r-- 1 root root      2152 Feb 11 23:50 ma-7-big-CRC.db
      -rw-r--r-- 1 root root        80 Feb 11 23:50 ma-5-big-TOC.txt
      -rw-r--r-- 1 root root    104178 Feb 11 23:50 ma-5-big-Summary.db
      -rw-r--r-- 1 root root     10264 Feb 11 23:50 ma-5-big-Statistics.db
      -rw-r--r-- 1 root root  10289077 Feb 11 23:50 ma-5-big-Index.db
      -rw-r--r-- 1 root root    757384 Feb 11 23:50 ma-5-big-Filter.db
      -rw-r--r-- 1 root root         9 Feb 11 23:50 ma-5-big-Digest.crc32
      -rw-r--r-- 1 root root 139201355 Feb 11 23:50 ma-5-big-Data.db
      -rw-r--r-- 1 root root      8508 Feb 11 23:50 ma-5-big-CRC.db
      root@bw-1:/srv/cassandra# md5sum /var/lib/cassandra/data/keyspace1/standard1-071efdc0d11811e590c3413ee28a6c90/ma-5-big-Summary.db
      5fca154fc790f7cfa37e8ad6d1c7552c
      

      BF ratio changed, node restarted:

      root@bw-1:/srv/cassandra# ls -ltr /var/lib/cassandra/data/keyspace1/standard1-071efdc0d11811e590c3413ee28a6c90/
      total 242168
      drwxr-xr-x 2 root root      4096 Feb 11 23:34 backups
      -rw-r--r-- 1 root root        80 Feb 11 23:50 ma-6-big-TOC.txt
      -rw-r--r-- 1 root root     10264 Feb 11 23:50 ma-6-big-Statistics.db
      -rw-r--r-- 1 root root   2607705 Feb 11 23:50 ma-6-big-Index.db
      -rw-r--r-- 1 root root    192440 Feb 11 23:50 ma-6-big-Filter.db
      -rw-r--r-- 1 root root        10 Feb 11 23:50 ma-6-big-Digest.crc32
      -rw-r--r-- 1 root root  35212125 Feb 11 23:50 ma-6-big-Data.db
      -rw-r--r-- 1 root root      2156 Feb 11 23:50 ma-6-big-CRC.db
      -rw-r--r-- 1 root root        80 Feb 11 23:50 ma-7-big-TOC.txt
      -rw-r--r-- 1 root root     10264 Feb 11 23:50 ma-7-big-Statistics.db
      -rw-r--r-- 1 root root   2607614 Feb 11 23:50 ma-7-big-Index.db
      -rw-r--r-- 1 root root    192432 Feb 11 23:50 ma-7-big-Filter.db
      -rw-r--r-- 1 root root         9 Feb 11 23:50 ma-7-big-Digest.crc32
      -rw-r--r-- 1 root root  35190400 Feb 11 23:50 ma-7-big-Data.db
      -rw-r--r-- 1 root root      2152 Feb 11 23:50 ma-7-big-CRC.db
      -rw-r--r-- 1 root root        80 Feb 11 23:50 ma-5-big-TOC.txt
      -rw-r--r-- 1 root root     10264 Feb 11 23:50 ma-5-big-Statistics.db
      -rw-r--r-- 1 root root  10289077 Feb 11 23:50 ma-5-big-Index.db
      -rw-r--r-- 1 root root    757384 Feb 11 23:50 ma-5-big-Filter.db
      -rw-r--r-- 1 root root         9 Feb 11 23:50 ma-5-big-Digest.crc32
      -rw-r--r-- 1 root root 139201355 Feb 11 23:50 ma-5-big-Data.db
      -rw-r--r-- 1 root root      8508 Feb 11 23:50 ma-5-big-CRC.db
      -rw-r--r-- 1 root root        80 Feb 12 00:03 ma-8-big-TOC.txt
      -rw-r--r-- 1 root root     14902 Feb 12 00:03 ma-8-big-Summary.db
      -rw-r--r-- 1 root root     10264 Feb 12 00:03 ma-8-big-Statistics.db
      -rw-r--r-- 1 root root   1458631 Feb 12 00:03 ma-8-big-Index.db
      -rw-r--r-- 1 root root     10808 Feb 12 00:03 ma-8-big-Filter.db
      -rw-r--r-- 1 root root        10 Feb 12 00:03 ma-8-big-Digest.crc32
      -rw-r--r-- 1 root root  19660275 Feb 12 00:03 ma-8-big-Data.db
      -rw-r--r-- 1 root root      1204 Feb 12 00:03 ma-8-big-CRC.db
      -rw-r--r-- 1 root root     26518 Feb 12 00:04 ma-7-big-Summary.db
      -rw-r--r-- 1 root root     26518 Feb 12 00:04 ma-6-big-Summary.db
      -rw-r--r-- 1 root root    104178 Feb 12 00:04 ma-5-big-Summary.db
      root@bw-1:/srv/cassandra# md5sum /var/lib/cassandra/data/keyspace1/standard1-071efdc0d11811e590c3413ee28a6c90/ma-5-big-Summary.db 
      5fca154fc790f7cfa37e8ad6d1c7552c 
      

      This hurts startup time and appears to do nothing useful whatsoever.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            KurtG Kurt Greaves Assign to me
            brandon.williams Brandon Williams
            Kurt Greaves
            Chris Lohfink
            Votes:
            1 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment