[CASSANDRA-8134] cassandra crashes sporadically on windows

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Not A Problem

Environment

OS: Windows Server 2012 R2 , 64 bit Build 9600

CPU:total 2 (2 cores per cpu, 1 threads per core) family 6 model 37 stepping 1, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, aes, tsc, tscinvbit

Memory: 4k page, physical 8388148k(3802204k free), swap 8388148k(4088948k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (24.60-b09) for windows-amd64 JRE (1.7.0_60-b19), built on May 7 2014 12:55:18 by "java_re" with unknown MS VC++:1600

• Severity: Normal
• Since Version: 1.2.2
• Assignee: Unassigned
• Reporter: Stefan Gusenbauer
• Created: 17/Oct/14 06:45
• Updated: 16/Apr/19 09:31
• Resolved: 27/Oct/14 15:55

Description

During our test runs cassandra crashes from time to time with the following stacktrace:

a similar bug can be found here https://issues.apache.org/jira/browse/CASSANDRA-5256

operating system is

--------------- S Y S T E M ---------------

OS: Windows Server 2012 R2 , 64 bit Build 9600

CPU:total 2 (2 cores per cpu, 1 threads per core) family 6 model 37 stepping 1, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, aes, tsc, tscinvbit

Memory: 4k page, physical 8388148k(3802204k free), swap 8388148k(4088948k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (24.60-b09) for windows-amd64 JRE (1.7.0_60-b19), built on May 7 2014 12:55:18 by "java_re" with unknown MS VC++:1600

time: Wed Oct 15 09:32:30 2014
elapsed time: 16 seconds

attached are several hs_err files too

j org.apache.cassandra.io.util.Memory.getLong(J)J+14 
j org.apache.cassandra.io.compress.CompressionMetadata.chunkFor(J)Lorg/apache/cassandra/io/compress/CompressionMetadata$Chunk;+53 
j org.apache.cassandra.io.compress.CompressedRandomAccessReader.reBuffer()V+9 
j org.apache.cassandra.io.compress.CompressedThrottledReader.reBuffer()V+13 
J 258 C2 org.apache.cassandra.io.util.RandomAccessReader.read()I (128 bytes) @ 0x000000000250cbcc [0x000000000250cae0+0xec] 
J 306 C2 java.io.RandomAccessFile.readUnsignedShort()I (33 bytes) @ 0x00000000025475e4 [0x0000000002547480+0x164] 
J 307 C2 org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(Ljava/io/DataInput;)Ljava/nio/ByteBuffer; (9 bytes) @ 0x000000000254c290 [0x000000000254c140+0x150] 
j org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next()Lorg/apache/cassandra/db/columniterator/OnDiskAtomIterator;+65 
j org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next()Ljava/lang/Object;+1 
j org.apache.cassandra.io.sstable.SSTableScanner.next()Lorg/apache/cassandra/db/columniterator/OnDiskAtomIterator;+41 
j org.apache.cassandra.io.sstable.SSTableScanner.next()Ljava/lang/Object;+1 
j org.apache.cassandra.utils.MergeIterator$Candidate.advance()Z+19 
j org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(Ljava/util/List;Ljava/util/Comparator;Lorg/apache/cassandra/utils/MergeIterator$Reducer;)V+71 
j org.apache.cassandra.utils.MergeIterator.get(Ljava/util/List;Ljava/util/Comparator;Lorg/apache/cassandra/utils/MergeIterator$Reducer;)Lorg/apache/cassandra/utils/IMergeIterator;+46 
j org.apache.cassandra.db.compaction.CompactionIterable.iterator()Lorg/apache/cassandra/utils/CloseableIterator;+15 
j org.apache.cassandra.db.compaction.CompactionTask.runWith(Ljava/io/File;)V+319 
j org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow()V+89 
j org.apache.cassandra.utils.WrappedRunnable.run()V+1 
j org.apache.cassandra.db.compaction.CompactionTask.executeInternal(Lorg/apache/cassandra/db/compaction/CompactionManager$CompactionExecutorStatsCollector;)I+6 
j org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(Lorg/apache/cassandra/db/compaction/CompactionManager$CompactionExecutorStatsCollector;)I+2 
j org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run()V+164 
j java.util.concurrent.Executors$RunnableAdapter.call()Ljava/lang/Object;+4 
j java.util.concurrent.FutureTask.run()V+42 
j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95 
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5 
j java.lang.Thread.run()V+11 

v ~StubRoutines::call_stub
V [jvm.dll+0x1ce043]

Issue Links

• is related to: CASSANDRA-5256 "Memory was freed" AssertionError During Major Compaction