Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-15451

INFO [CompactionExecutor:8] 2019-12-13 17:49:53,408 NoSpamLogger.java:91 - Maximum memory usage reached (4294967296), cannot allocate chunk of 1048576

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Triage Needed
    • Normal
    • Resolution: Unresolved
    • None
    • Cluster/Gossip
    • None
    • All
    • None

    Description

      Hi All,

       

      I getting errors on Cassandra 3.11.4 debug.log as below.

       

      what could be the reason ? how to avoid these errors.??

       

      I can see partition size is 1.9 MB. Heap size 16GB.

       

      nodetool tablestats test_data.local_data -H

      Total number of tables: 37

      ----------------

      Keyspace : test_data

              Read Count: 0

              Read Latency: NaN ms

              Write Count: 48776898

              Write Latency: 1.534334614042082 ms

              Pending Flushes: 2

                      Table: local_data

                      SSTable count: 84

                      Space used (live): 115.53 GiB

                      Space used (total): 115.53 GiB

                      Space used by snapshots (total): 165.45 KiB

                      Off heap memory used (total): 216.71 MiB

                      SSTable Compression Ratio: 0.5440445152549487

                      Number of partitions (estimate): 139647

                      Memtable cell count: 1495900

                      Memtable data size: 167.87 MiB

                      Memtable off heap memory used: 174.38 MiB

                      Memtable switch count: 2016

                      Local read count: 0

                      Local read latency: NaN ms

                      Local write count: 48777246

                      Local write latency: 1.580 ms

                      Pending flushes: 2

                      Percent repaired: 0.0

                      Bloom filter false positives: 0

                      Bloom filter false ratio: 0.00000

                      Bloom filter space used: 287.65 KiB

                      Bloom filter off heap memory used: 431.88 KiB

                      Index summary off heap memory used: 160.4 KiB

                      Compression metadata off heap memory used: 41.75 MiB

                      Compacted partition minimum bytes: 3974

                      Compacted partition maximum bytes: 1955666

                      Compacted partition mean bytes: 1109275

                      Average live cells per slice (last five minutes): NaN

                      Maximum live cells per slice (last five minutes): 0

                      Average tombstones per slice (last five minutes): NaN

                      Maximum tombstones per slice (last five minutes): 0

                      Dropped Mutations: 6 bytes

       

       

      ========================================

       

      nodetool tablehistograms test_data local_data

      test_data/local_data histograms

      Percentile  SSTables     Write Latency      Read Latency    Partition Size        Cell Count

                                    (micros)          (micros)           (bytes)

      50%             0.00            315.85              0.00           1358102             61214

      75%             0.00            943.13              0.00           1955666            152321

      95%             0.00           2816.16              0.00           1955666            152321

      98%             0.00           8409.01              0.00           1955666            152321

      99%             0.00          36157.19              0.00           1955666            152321

      Min             0.00             73.46              0.00              3974               373

      Max             0.00         557074.61              0.00           1955666            152321

       

      ====================================

       

      nodetool info

      ID                     : 2985f5ef-5b84-4654-91f6-dc459741e9fc

      Gossip active          : true

      Thrift active          : false

      Native Transport active: true

      Load                   : 117.25 GiB

      Generation No          : 1576230314

      Uptime (seconds)       : 15745

      Heap Memory (MB)       : 8040.00 / 16384.00

      Off Heap Memory (MB)   : 287.19

      Data Center            : dc1

      Rack                   : rack1

      Exceptions             : 0

      Key Cache              : entries 36568, size 66.79 MiB, capacity 100 MiB, 26555 hits, 63045 requests, 0.421 recent hit rate, 14400 save period in seconds

      Row Cache              : entries 0, size 0 bytes, capacity 0 bytes, 0 hits, 0 requests, NaN recent hit rate, 0 save period in seconds

      Counter Cache          : entries 0, size 0 bytes, capacity 50 MiB, 0 hits, 0 requests, NaN recent hit rate, 7200 save period in seconds

      Chunk Cache            : entries 65024, size 3.97 GiB, capacity 3.97 GiB, 12839660 misses, 15296535 requests, 0.161 recent hit rate, 468.900 microseconds miss latency

      Percent Repaired       : 1.8637552068836277E-7%

      Token                  : (invoke with T/-tokens to see all 256 tokens)

       

      ==================================

       

      nodetool netstats

      Mode: NORMAL

      Not sending any streams.

      Read Repair Statistics:

      Attempted: 0

      Mismatch (Blocking): 0

      Mismatch (Background): 0

      Pool Name                    Active   Pending      Completed   Dropped

      Large messages                  n/a         2              0         2

      Small messages                  n/a         0       66196004         4

      Gossip messages                 n/a         0          54691        30

      =========================

       

      INFO  [CompactionExecutor:8] 2019-12-13 17:49:53,408 NoSpamLogger.java:91 - Maximum memory usage reached (4294967296), cannot allocate chunk of 1048576

      INFO  [CompactionExecutor:9] 2019-12-13 18:04:55,683 NoSpamLogger.java:91 - Maximum memory usage reached (4294967296), cannot allocate chunk of 1048576

      INFO  [CompactionExecutor:6] 2019-12-13 18:21:39,420 NoSpamLogger.java:91 - Maximum memory usage reached (4294967296), cannot allocate chunk of 1048576

      INFO  [CompactionExecutor:8] 2019-12-13 18:36:45,011 NoSpamLogger.java:91 - Maximum memory usage reached (4294967296), cannot allocate chunk of 1048576

      INFO  [CompactionExecutor:9] 2019-12-13 18:51:53,479 NoSpamLogger.java:91 - Maximum memory usage reached (4294967296), cannot allocate chunk of 1048576

      INFO  [CompactionExecutor:7] 2019-12-13 19:06:55,898 NoSpamLogger.java:91 - Maximum memory usage reached (4294967296), cannot allocate chunk of 1048576

       

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            sateesh.v sateesh Vemulapalli
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: