Uploaded image for project: 'Apache Cassandra'
  1. Apache Cassandra
  2. CASSANDRA-2635

make cache skipping optional

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Low
    • Resolution: Fixed
    • 1.1.1, 1.2.0 beta 1
    • None
    • None

    Description

      We've applied this patch locally in order to turn of page skipping; not completely but only for compaction/repair situations where it can be directly detrimental in the sense of causing data to become cold even though your entire data set fits in memory.

      It's better than completely disabling DONTNEED because the cache skipping does make sense and has no relevant (that I can see) detrimental effects in some cases, like when dumping caches.

      The patch is against 0.7.5 right now but if the change is desired I can make a patch for trunk. Also, the name of the configuration option is dubious since saying 'false' does not actually turn it off completely. I wasn't able to figure out a good name that conveyed the functionality in a short brief name however.

      A related concern as discussed in CASSANDRA-1902 is that the cache skipping isn't fsync:ing and so won't work reliably on writes. If the feature is to be retained that's something to fix in a different ticket.

      A question is also whether to retain the default to true or change it to false. I'm kinda leaning to false since it's detrimental in the "easy" cases of little data. In "big" cases with lots of data people will have to think and tweak anyway, so better to put the burden on that end.

      Attachments

        1. CASSANDRA-2635-trunk-1.txt
          6 kB
          Harish Doddi
        2. CASSANDRA-2635-trunk.txt
          6 kB
          Harish Doddi
        3. CASSANDRA-2635-075.txt
          6 kB
          Peter Schuller
        4. 0001-CASSANDRA-2635-v3.patch
          5 kB
          Vijay

        Activity

          People

            harishd Harish Doddi
            scode Peter Schuller
            Harish Doddi
            Vijay
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: