Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-208

OOM intermittently during compaction

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Urgent
    • Resolution: Fixed
    • 0.4
    • None
    • None
    • arch: x86_64
      os: Linux version 2.6.18-92.1.22.el5
      java: nio2-ea-bin-b99-linux-x64-05_feb_2009

    • Critical

    Description

      jvm crashes intermittently during compaction. Our test data set is not that big, less than 10 GB.
      When jvm is about to crash, we see that it consumes a lot of memory (exceeding the max heap size).

      The excessive memory usage during compaction is caused by the maintenance of blockIndexes_ in SSTable. this blockIndexes_ was only introduced to the apache version.

      Attachments

        1. ASF.LICENSE.NOT.GRANTED--0003-split-sstable-into-data-index-and-bloom-filter-files.txt
          73 kB
          Jonathan Ellis
        2. ASF.LICENSE.NOT.GRANTED--0002-r-m-touch.txt
          42 kB
          Jonathan Ellis
        3. ASF.LICENSE.NOT.GRANTED--0001-CASSANDRA-208-cleanup.txt
          26 kB
          Jonathan Ellis
        4. 208-3.patch
          2 kB
          Jonathan Ellis
        5. 208-2.patch
          1 kB
          Jonathan Ellis
        6. 208.patch
          81 kB
          Jonathan Ellis
        7. 0005-fix-test-order-dependent-failures.patch
          4 kB
          Jonathan Ellis
        8. 0004-fix-ColumnReader-add-tests.patch
          7 kB
          Jonathan Ellis

        Activity

          People

            jbellis Jonathan Ellis
            jihuang Jiansheng Huang
            Jonathan Ellis
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: