Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-896

GC issues with LinkedBlockingQueue, very large heap sizes

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Fix Version/s: 0.6
    • Component/s: None
    • Labels:
      None

      Description

      We were doing a large import over thrift today (250M rows) with 50 columns each. We noticed when this process started, that the heap usage slowly began to rise. Eventually hitting 10GB. After investigating heap dumps we noticed this is linked to GC problems in the JVM for LinkedBlockingQueue. Sending a hint through jconsole to perform GC didn't help either.

      See this article:

      http://tech.puredanger.com/2009/02/11/linkedblockingqueue-garbagecollection/

      JDK 1.6.18 doesn't have this fix yet either. We could possibly add the change from:
      http://svn.apache.org/repos/asf/harmony/standard/classlib/trunk/modules/concurrent/src/main/java/java/util/concurrent/LinkedBlockingQueue.java

        Attachments

        1. WriteOpsLBQvsABQ.png
          57 kB
          Chris Goffinet
        2. Screen shot 2010-03-14 at 10.20.31 PM.png
          139 kB
          Chris Goffinet
        3. Screen shot 2010-03-14 at 10.19.09 PM.png
          117 kB
          Chris Goffinet
        4. HeapMemoryLBQvsABQ.png
          73 kB
          Chris Goffinet

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              lenn0x Chris Goffinet
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: