Cassandra
  1. Cassandra
  2. CASSANDRA-5906

Avoid allocating over-large bloom filters

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Fix Version/s: 2.1 beta1
    • Component/s: Core
    • Labels:
      None

      Description

      We conservatively estimate the number of partitions post-compaction to be the total number of partitions pre-compaction. That is, we assume the worst-case scenario of no partition overlap at all.

      This can result in substantial memory wasted in sstables resulting from highly overlapping compactions.

      1. 5906.txt
        205 kB
        Yuki Morishita

        Issue Links

          Activity

          Jonathan Ellis created issue -
          Jonathan Ellis made changes -
          Field Original Value New Value
          Priority Minor [ 4 ] Major [ 3 ]
          Sylvain Lebresne made changes -
          Fix Version/s 2.0.2 [ 12325023 ]
          Fix Version/s 2.0.1 [ 12324542 ]
          Chris Burroughs made changes -
          Comment [ FYI released a version of stream-lib today. ]
          Sylvain Lebresne made changes -
          Fix Version/s 2.0.3 [ 12325322 ]
          Fix Version/s 2.0.2 [ 12325023 ]
          Yuki Morishita made changes -
          Fix Version/s 2.1 [ 12324159 ]
          Fix Version/s 2.0.3 [ 12325322 ]
          Yuki Morishita made changes -
          Link This issue is blocked by CASSANDRA-6356 [ CASSANDRA-6356 ]
          Yuki Morishita made changes -
          Attachment 5906.txt [ 12618979 ]
          Yuki Morishita made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Yuki Morishita made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Reviewer Jonathan Ellis [ jbellis ]
          Resolution Fixed [ 1 ]
          Sylvain Lebresne made changes -
          Fix Version/s 2.1 beta1 [ 12326275 ]
          Fix Version/s 2.1 [ 12324159 ]

            People

            • Assignee:
              Yuki Morishita
              Reporter:
              Jonathan Ellis
              Reviewer:
              Jonathan Ellis
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development