Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-2215

VM Crash when bootstrapping new node

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Normal
    • Resolution: Invalid
    • None
    • None
    • None
    • Normal

    Description

      I just wanted to restart my 3-node test setup. For that I use three nodes: 10.0.0.1, 10.0.0.2, 10.0.0.3
      I cleaned all data directories and started up node1. After a while I started node2 which bootstraps from node1, while doing that, node1 crashed:

      Last log line on node1: DEBUG 12:14:00,531 attempting to connect to /10.0.0.2

      #
      # A fatal error has been detected by the Java Runtime Environment:
      #
      #  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d9a84cd, pid=4028, tid=3840
      #
      # JRE version: 6.0_23-b05
      # Java VM: Java HotSpot(TM) Client VM (19.0-b09 mixed mode windows-x86 )
      # Problematic frame:
      # V  [jvm.dll+0x1084cd]
      #
      # If you would like to submit a bug report, please visit:
      #   http://java.sun.com/webapps/bugreport/crash.jsp
      #
      
      ---------------  T H R E A D  ---------------
      
      Current thread (0x49e6a800):  JavaThread "WRITE-/10.0.0.2" [_thread_in_vm, id=3840, stack(0x4fed0000,0x4ff20000)]
      
      siginfo: ExceptionCode=0xc0000005, reading address 0x00000000
      
      Registers:
      EAX=0x00000000, EBX=0x49e6a800, ECX=0x00000006, EDX=0x6db15308
      ESP=0x4ff1f7b8, EBP=0x4ff1f7d4, ESI=0x00000000, EDI=0x42debad0
      EIP=0x6d9a84cd, EFLAGS=0x00010246
      
      Register to memory mapping:
      
      EAX=0x00000000
      0x00000000 is pointing to unknown location
      
      EBX=0x49e6a800
      "WRITE-/10.0.0.2" prio=6 tid=0x49e6a800 nid=0xf00 runnable [0x4ff1f000]
         java.lang.Thread.State: RUNNABLE
      
      ECX=0x00000006
      0x00000006 is pointing to unknown location
      
      EDX=0x6db15308
      0x6db15308 is pointing to unknown location
      
      ESP=0x4ff1f7b8
      0x4ff1f7b8 is pointing into the stack for thread: 0x49e6a800
      "WRITE-/10.0.0.2" prio=6 tid=0x49e6a800 nid=0xf00 runnable [0x4ff1f000]
         java.lang.Thread.State: RUNNABLE
      
      EBP=0x4ff1f7d4
      0x4ff1f7d4 is pointing into the stack for thread: 0x49e6a800
      "WRITE-/10.0.0.2" prio=6 tid=0x49e6a800 nid=0xf00 runnable [0x4ff1f000]
         java.lang.Thread.State: RUNNABLE
      
      ESI=0x00000000
      0x00000000 is pointing to unknown location
      
      EDI=0x42debad0
      {instance class} 
       - klass: {other class}
      
      
      Top of Stack: (sp=0x4ff1f7b8)
      0x4ff1f7b8:   42debad0 49e6a918 4ff1fad4 49e6a800
      0x4ff1f7c8:   00000000 4ff1fe20 6daa8ef0 4ff1f80c
      0x4ff1f7d8:   6d6b803c 49e6a800 00000000 00000000
      0x4ff1f7e8:   00000010 4ff1f7fc 00000e40 49e6a918
      0x4ff1f7f8:   4ff1fad8 4ff1fad8 4ff1f7f4 4ff1fad8
      0x4ff1f808:   4ff1fe20 4ff1fa78 6d6b5e6e 00000000
      0x4ff1f818:   4ff1fad4 00001b58 4ff1fa44 4ff1fa40
      0x4ff1f828:   00000000 49e6a800 42de7280 42de7288 
      
      Instructions: (pc=0x6d9a84cd)
      0x6d9a84bd:   8d 4d f0 e8 2b b5 08 00 8b 75 10 85 f6 8b 45 0c
      0x6d9a84cd:   8b 10 7c 50 8b 45 14 85 c0 7c 49 8b 7a 08 8d 0c 
      
      
      Stack: [0x4fed0000,0x4ff20000],  sp=0x4ff1f7b8,  free space=317k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      V  [jvm.dll+0x1084cd]
      C  [net.dll+0x803c]
      C  [net.dll+0x5e6e]
      j  java.net.PlainSocketImpl.socketConnect(Ljava/net/InetAddress;II)V+0
      j  java.net.PlainSocketImpl.doConnect(Ljava/net/InetAddress;II)V+10
      j  java.net.PlainSocketImpl.connectToAddress(Ljava/net/InetAddress;II)V+23
      j  java.net.PlainSocketImpl.connect(Ljava/net/SocketAddress;I)V+71
      j  java.net.SocksSocketImpl.connect(Ljava/net/SocketAddress;I)V+332
      j  java.net.Socket.connect(Ljava/net/SocketAddress;I)V+179
      j  java.net.Socket.connect(Ljava/net/SocketAddress;)V+3
      j  java.net.Socket.<init>(Ljava/net/SocketAddress;Ljava/net/SocketAddress;Z)V+86
      j  java.net.Socket.<init>(Ljava/net/InetAddress;ILjava/net/InetAddress;I)V+29
      j  org.apache.cassandra.net.OutboundTcpConnection.connect()Z+73
      j  org.apache.cassandra.net.OutboundTcpConnection.run()V+27
      v  ~StubRoutines::call_stub
      V  [jvm.dll+0xf33c9]
      V  [jvm.dll+0x188a91]
      V  [jvm.dll+0xf3587]
      V  [jvm.dll+0xf35eb]
      V  [jvm.dll+0x11e780]
      V  [jvm.dll+0x1ea6c4]
      V  [jvm.dll+0x18843c]
      C  [msvcr71.dll+0x9565]
      C  [kernel32.dll+0xb729]
      
      Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
      j  java.net.PlainSocketImpl.socketConnect(Ljava/net/InetAddress;II)V+0
      j  java.net.PlainSocketImpl.doConnect(Ljava/net/InetAddress;II)V+10
      j  java.net.PlainSocketImpl.connectToAddress(Ljava/net/InetAddress;II)V+23
      j  java.net.PlainSocketImpl.connect(Ljava/net/SocketAddress;I)V+71
      j  java.net.SocksSocketImpl.connect(Ljava/net/SocketAddress;I)V+332
      j  java.net.Socket.connect(Ljava/net/SocketAddress;I)V+179
      j  java.net.Socket.connect(Ljava/net/SocketAddress;)V+3
      j  java.net.Socket.<init>(Ljava/net/SocketAddress;Ljava/net/SocketAddress;Z)V+86
      j  java.net.Socket.<init>(Ljava/net/InetAddress;ILjava/net/InetAddress;I)V+29
      j  org.apache.cassandra.net.OutboundTcpConnection.connect()Z+73
      j  org.apache.cassandra.net.OutboundTcpConnection.run()V+27
      v  ~StubRoutines::call_stub
      
      ---------------  P R O C E S S  ---------------
      
      Java Threads: ( => current thread )
      =>0x49e6a800 JavaThread "WRITE-/10.0.0.2" [_thread_in_vm, id=3840, stack(0x4fed0000,0x4ff20000)]
        0x49e69400 JavaThread "WRITE-/10.0.0.2" [_thread_blocked, id=7380, stack(0x4fe80000,0x4fed0000)]
        0x4966fc00 JavaThread "Thread-6" [_thread_in_native, id=5056, stack(0x4fe30000,0x4fe80000)]
        0x49839400 JavaThread "JMX server connection timeout 105" daemon [_thread_blocked, id=5636, stack(0x4fde0000,0x4fe30000)]
        0x49671400 JavaThread "JMX server connection timeout 104" daemon [_thread_blocked, id=6728, stack(0x4fd90000,0x4fde0000)]
        0x4968bc00 JavaThread "RMI TCP Connection(4)-10.0.0.1" daemon [_thread_in_native, id=5304, stack(0x4fd40000,0x4fd90000)]
        0x496c2800 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=896, stack(0x4fcf0000,0x4fd40000)]
        0x496a4800 JavaThread "RMI TCP Connection(3)-10.0.0.1" daemon [_thread_in_native, id=2428, stack(0x4fca0000,0x4fcf0000)]
        0x002b9000 JavaThread "DestroyJavaVM" [_thread_blocked, id=6008, stack(0x008c0000,0x00910000)]
        0x49df6400 JavaThread "Thread-3" [_thread_in_native, id=6684, stack(0x4fc50000,0x4fca0000)]
        0x49e6f000 JavaThread "HintedHandoff:1" [_thread_blocked, id=1496, stack(0x4fc00000,0x4fc50000)]
        0x49e62000 JavaThread "MiscStage:1" [_thread_blocked, id=6524, stack(0x4fbb0000,0x4fc00000)]
        0x49e60800 JavaThread "MigrationStage:1" [_thread_blocked, id=3312, stack(0x4fb60000,0x4fbb0000)]
        0x49e5f000 JavaThread "AntiEntropyStage:1" [_thread_blocked, id=8072, stack(0x4fb10000,0x4fb60000)]
        0x49e5d800 JavaThread "GossipStage:1" [_thread_blocked, id=3676, stack(0x4fac0000,0x4fb10000)]
        0x49e5c400 JavaThread "StreamStage:1" [_thread_blocked, id=3164, stack(0x4fa70000,0x4fac0000)]
        0x49e5a800 JavaThread "InternalResponseStage:2" [_thread_blocked, id=4344, stack(0x4fa20000,0x4fa70000)]
        0x49e59400 JavaThread "InternalResponseStage:1" [_thread_blocked, id=6712, stack(0x4f9d0000,0x4fa20000)]
        0x49e57c00 JavaThread "RequestResponseStage:2" [_thread_blocked, id=7844, stack(0x4f980000,0x4f9d0000)]
        0x49e56400 JavaThread "RequestResponseStage:1" [_thread_blocked, id=8028, stack(0x4f930000,0x4f980000)]
        0x49e54c00 JavaThread "ReadStage:32" [_thread_blocked, id=4816, stack(0x4f8e0000,0x4f930000)]
        0x49e53400 JavaThread "ReadStage:31" [_thread_blocked, id=4632, stack(0x4f890000,0x4f8e0000)]
        0x49e51c00 JavaThread "ReadStage:30" [_thread_blocked, id=7840, stack(0x4f840000,0x4f890000)]
        0x49e50400 JavaThread "ReadStage:29" [_thread_blocked, id=6676, stack(0x4f7f0000,0x4f840000)]
        0x49e4ec00 JavaThread "ReadStage:28" [_thread_blocked, id=6768, stack(0x4f7a0000,0x4f7f0000)]
        0x49e4d400 JavaThread "ReadStage:27" [_thread_blocked, id=6640, stack(0x4f750000,0x4f7a0000)]
        0x49e4bc00 JavaThread "ReadStage:26" [_thread_blocked, id=7792, stack(0x4f700000,0x4f750000)]
        0x49e4a800 JavaThread "ReadStage:25" [_thread_blocked, id=7492, stack(0x4f6b0000,0x4f700000)]
        0x49e49000 JavaThread "ReadStage:24" [_thread_blocked, id=6116, stack(0x4f660000,0x4f6b0000)]
        0x49e47800 JavaThread "ReadStage:23" [_thread_blocked, id=5432, stack(0x4f610000,0x4f660000)]
        0x49e46000 JavaThread "ReadStage:22" [_thread_blocked, id=5140, stack(0x4f5c0000,0x4f610000)]
        0x49e44800 JavaThread "ReadStage:21" [_thread_blocked, id=2584, stack(0x4f570000,0x4f5c0000)]
        0x49e43000 JavaThread "ReadStage:20" [_thread_blocked, id=5536, stack(0x4f520000,0x4f570000)]
        0x49e41800 JavaThread "ReadStage:19" [_thread_blocked, id=3496, stack(0x4f4d0000,0x4f520000)]
        0x49e40000 JavaThread "ReadStage:18" [_thread_blocked, id=1344, stack(0x4f480000,0x4f4d0000)]
        0x49e3ec00 JavaThread "ReadStage:17" [_thread_blocked, id=7828, stack(0x4f430000,0x4f480000)]
        0x49e3d000 JavaThread "ReadStage:16" [_thread_blocked, id=3224, stack(0x4f3e0000,0x4f430000)]
        0x49e3b800 JavaThread "ReadStage:15" [_thread_blocked, id=5168, stack(0x4f390000,0x4f3e0000)]
        0x49e3a400 JavaThread "ReadStage:14" [_thread_blocked, id=3260, stack(0x4f340000,0x4f390000)]
        0x49e38800 JavaThread "ReadStage:13" [_thread_blocked, id=5760, stack(0x4f2f0000,0x4f340000)]
        0x49e37400 JavaThread "ReadStage:12" [_thread_blocked, id=7808, stack(0x4f2a0000,0x4f2f0000)]
        0x49e35c00 JavaThread "ReadStage:11" [_thread_blocked, id=272, stack(0x4f250000,0x4f2a0000)]
        0x49e34400 JavaThread "ReadStage:10" [_thread_blocked, id=6168, stack(0x4f200000,0x4f250000)]
        0x49e32c00 JavaThread "ReadStage:9" [_thread_blocked, id=4112, stack(0x4f1b0000,0x4f200000)]
        0x49e31800 JavaThread "ReadStage:8" [_thread_blocked, id=4600, stack(0x4f160000,0x4f1b0000)]
        0x49e30000 JavaThread "ReadStage:7" [_thread_blocked, id=7480, stack(0x4f110000,0x4f160000)]
        0x49e2e800 JavaThread "ReadStage:6" [_thread_blocked, id=4460, stack(0x4f0c0000,0x4f110000)]
        0x49e2d000 JavaThread "ReadStage:5" [_thread_blocked, id=5380, stack(0x4f070000,0x4f0c0000)]
        0x49e2b800 JavaThread "ReadStage:4" [_thread_blocked, id=3620, stack(0x4f020000,0x4f070000)]
        0x49e2a000 JavaThread "ReadStage:3" [_thread_blocked, id=6492, stack(0x4efd0000,0x4f020000)]
        0x49e28800 JavaThread "ReadStage:2" [_thread_blocked, id=6280, stack(0x4ef80000,0x4efd0000)]
        0x49e27400 JavaThread "ReadStage:1" [_thread_blocked, id=3088, stack(0x4ef30000,0x4ef80000)]
        0x49e25800 JavaThread "MutationStage:32" [_thread_blocked, id=6140, stack(0x4eee0000,0x4ef30000)]
        0x49e24000 JavaThread "MutationStage:31" [_thread_blocked, id=5196, stack(0x4ee90000,0x4eee0000)]
        0x49e22c00 JavaThread "MutationStage:30" [_thread_blocked, id=5216, stack(0x4ee40000,0x4ee90000)]
        0x49e21400 JavaThread "MutationStage:29" [_thread_blocked, id=5396, stack(0x4edf0000,0x4ee40000)]
        0x49e1fc00 JavaThread "MutationStage:28" [_thread_blocked, id=7592, stack(0x4eda0000,0x4edf0000)]
        0x49e1e400 JavaThread "MutationStage:27" [_thread_blocked, id=7776, stack(0x4ed50000,0x4eda0000)]
        0x49e1cc00 JavaThread "MutationStage:26" [_thread_blocked, id=6292, stack(0x4ed00000,0x4ed50000)]
        0x49e1b400 JavaThread "MutationStage:25" [_thread_blocked, id=4032, stack(0x4ecb0000,0x4ed00000)]
        0x49e19c00 JavaThread "MutationStage:24" [_thread_blocked, id=6760, stack(0x4ec60000,0x4ecb0000)]
        0x49e18400 JavaThread "MutationStage:23" [_thread_blocked, id=7464, stack(0x4ec10000,0x4ec60000)]
        0x49e16c00 JavaThread "MutationStage:22" [_thread_blocked, id=6732, stack(0x4ebc0000,0x4ec10000)]
        0x49e15400 JavaThread "MutationStage:21" [_thread_blocked, id=7048, stack(0x4eb70000,0x4ebc0000)]
        0x49e14000 JavaThread "MutationStage:20" [_thread_blocked, id=3800, stack(0x4eb20000,0x4eb70000)]
        0x49e12800 JavaThread "MutationStage:19" [_thread_blocked, id=7820, stack(0x4ead0000,0x4eb20000)]
        0x49e11000 JavaThread "MutationStage:18" [_thread_blocked, id=7624, stack(0x4ea80000,0x4ead0000)]
        0x49e0f800 JavaThread "MutationStage:17" [_thread_blocked, id=4508, stack(0x4ea30000,0x4ea80000)]
        0x49e0e000 JavaThread "MutationStage:16" [_thread_blocked, id=4784, stack(0x4e9e0000,0x4ea30000)]
        0x49e0c800 JavaThread "MutationStage:15" [_thread_blocked, id=7132, stack(0x4e990000,0x4e9e0000)]
        0x49e0b000 JavaThread "MutationStage:14" [_thread_blocked, id=2916, stack(0x4e940000,0x4e990000)]
        0x49e09c00 JavaThread "MutationStage:13" [_thread_blocked, id=6900, stack(0x4e8f0000,0x4e940000)]
        0x49e08400 JavaThread "MutationStage:12" [_thread_blocked, id=8096, stack(0x4e8a0000,0x4e8f0000)]
        0x49e06c00 JavaThread "MutationStage:11" [_thread_blocked, id=7596, stack(0x4e850000,0x4e8a0000)]
        0x49e05800 JavaThread "MutationStage:10" [_thread_blocked, id=1420, stack(0x4e800000,0x4e850000)]
        0x49e03c00 JavaThread "MutationStage:9" [_thread_blocked, id=8176, stack(0x4e7b0000,0x4e800000)]
        0x49e02400 JavaThread "MutationStage:8" [_thread_blocked, id=5496, stack(0x4e760000,0x4e7b0000)]
        0x49e01000 JavaThread "MutationStage:7" [_thread_blocked, id=7868, stack(0x4e710000,0x4e760000)]
        0x49dff800 JavaThread "MutationStage:6" [_thread_blocked, id=1860, stack(0x4e6c0000,0x4e710000)]
        0x49dfc400 JavaThread "MutationStage:5" [_thread_blocked, id=3876, stack(0x4e670000,0x4e6c0000)]
        0x49dfb000 JavaThread "MutationStage:4" [_thread_blocked, id=4088, stack(0x4e620000,0x4e670000)]
        0x49df9c00 JavaThread "MutationStage:3" [_thread_blocked, id=3352, stack(0x4e5d0000,0x4e620000)]
        0x49df8400 JavaThread "MutationStage:2" [_thread_blocked, id=4604, stack(0x4e580000,0x4e5d0000)]
        0x49df7000 JavaThread "MutationStage:1" [_thread_blocked, id=8092, stack(0x4e530000,0x4e580000)]
        0x49de7000 JavaThread "ACCEPT-/10.0.0.1" [_thread_in_native, id=2432, stack(0x4e4e0000,0x4e530000)]
        0x49dec000 JavaThread "SSTABLE-DELETER" [_thread_blocked, id=7452, stack(0x4e490000,0x4e4e0000)]
        0x49dee400 JavaThread "CompactionExecutor:1" [_thread_blocked, id=8124, stack(0x4a430000,0x4a480000)]
        0x49da2800 JavaThread "MemtablePostFlusher:1" [_thread_blocked, id=7080, stack(0x4a3e0000,0x4a430000)]
        0x49da1400 JavaThread "FlushWriter:1" [_thread_blocked, id=8052, stack(0x4a390000,0x4a3e0000)]
        0x49da0400 JavaThread "FlushSorter:1" [_thread_blocked, id=5984, stack(0x4a340000,0x4a390000)]
        0x49dd5800 JavaThread "PERIODIC-COMMIT-LOG-SYNCER" [_thread_blocked, id=7368, stack(0x4a2f0000,0x4a340000)]
        0x49db1000 JavaThread "COMMIT-LOG-WRITER" [_thread_blocked, id=5916, stack(0x4a250000,0x4a2a0000)]
        0x49db3c00 JavaThread "EXPIRING-MAP-TIMER-1" daemon [_thread_blocked, id=5312, stack(0x4a200000,0x4a250000)]
        0x49d9d800 JavaThread "ScheduledTasks:1" [_thread_blocked, id=1436, stack(0x4a1b0000,0x4a200000)]
        0x49d6e000 JavaThread "FileWatchdog" daemon [_thread_blocked, id=8032, stack(0x4a160000,0x4a1b0000)]
        0x4984b800 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=4204, stack(0x49cc0000,0x49d10000)]
        0x49846c00 JavaThread "RMI TCP Accept-8081" daemon [_thread_in_native, id=7672, stack(0x49c70000,0x49cc0000)]
        0x4983e800 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=1316, stack(0x49c20000,0x49c70000)]
        0x4965fc00 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=6360, stack(0x49990000,0x499e0000)]
        0x4965a000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=7128, stack(0x49940000,0x49990000)]
        0x49658800 JavaThread "Attach Listener" daemon [_thread_blocked, id=6848, stack(0x498f0000,0x49940000)]
        0x49657000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=1372, stack(0x498a0000,0x498f0000)]
        0x49655c00 JavaThread "Surrogate Locker Thread (CMS)" daemon [_thread_blocked, id=7200, stack(0x49850000,0x498a0000)]
        0x46d56c00 JavaThread "Finalizer" daemon [_thread_blocked, id=7364, stack(0x49600000,0x49650000)]
        0x46d52000 JavaThread "Reference Handler" daemon [_thread_blocked, id=7860, stack(0x495b0000,0x49600000)]
      
      Other Threads:
        0x46d4f800 VMThread [stack: 0x49560000,0x495b0000] [id=8128]
        0x4984d800 WatcherThread [stack: 0x49d10000,0x49d60000] [id=8116]
      
      VM state:not at safepoint (normal execution)
      
      VM Mutex/Monitor currently owned by a thread: None
      
      Heap
       par new generation   total 14784K, used 13579K [0x02a30000, 0x03a30000, 0x04a30000)
        eden space 13184K,  96% used [0x02a30000, 0x036a4fa8, 0x03710000)
        from space 1600K,  51% used [0x03710000, 0x037dded0, 0x038a0000)
        to   space 1600K,   0% used [0x038a0000, 0x038a0000, 0x03a30000)
       concurrent mark-sweep generation total 245760K, used 132272K [0x04a30000, 0x13a30000, 0x42a30000)
       concurrent-mark-sweep perm gen total 12288K, used 9365K [0x42a30000, 0x43630000, 0x46a30000)
      
      Dynamic libraries:
      0x00400000 - 0x00424000 	C:\Programme\Java\jdk1.6.0_23\bin\java.exe
      0x7c910000 - 0x7c9c9000 	C:\WINDOWS\system32\ntdll.dll
      0x7c800000 - 0x7c908000 	C:\WINDOWS\system32\kernel32.dll
      0x77da0000 - 0x77e4a000 	C:\WINDOWS\system32\ADVAPI32.dll
      0x77e50000 - 0x77ee3000 	C:\WINDOWS\system32\RPCRT4.dll
      0x77fc0000 - 0x77fd1000 	C:\WINDOWS\system32\Secur32.dll
      0x7c340000 - 0x7c396000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\msvcr71.dll
      0x6d8a0000 - 0x6db4c000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\client\jvm.dll
      0x7e360000 - 0x7e3f1000 	C:\WINDOWS\system32\USER32.dll
      0x77ef0000 - 0x77f39000 	C:\WINDOWS\system32\GDI32.dll
      0x76af0000 - 0x76b1e000 	C:\WINDOWS\system32\WINMM.dll
      0x76330000 - 0x7634d000 	C:\WINDOWS\system32\IMM32.DLL
      0x6d850000 - 0x6d85c000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\verify.dll
      0x6d3d0000 - 0x6d3ef000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\java.dll
      0x6d330000 - 0x6d338000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\hpi.dll
      0x76bb0000 - 0x76bbb000 	C:\WINDOWS\system32\PSAPI.DLL
      0x6d890000 - 0x6d89f000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\zip.dll
      0x6d600000 - 0x6d609000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\management.dll
      0x6d6b0000 - 0x6d6c3000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\net.dll
      0x71a10000 - 0x71a27000 	C:\WINDOWS\system32\WS2_32.dll
      0x77be0000 - 0x77c38000 	C:\WINDOWS\system32\msvcrt.dll
      0x71a00000 - 0x71a08000 	C:\WINDOWS\system32\WS2HELP.dll
      0x719b0000 - 0x719f0000 	C:\WINDOWS\system32\mswsock.dll
      0x66710000 - 0x66769000 	C:\WINDOWS\system32\hnetcfg.dll
      0x590b0000 - 0x590b7000 	C:\WINDOWS\System32\wship6.dll
      0x76ee0000 - 0x76f07000 	C:\WINDOWS\system32\DNSAPI.dll
      0x76f70000 - 0x76f78000 	C:\WINDOWS\System32\winrnr.dll
      0x76f20000 - 0x76f4d000 	C:\WINDOWS\system32\WLDAP32.dll
      0x76f80000 - 0x76f86000 	C:\WINDOWS\system32\rasadhlp.dll
      0x68000000 - 0x68036000 	C:\WINDOWS\system32\rsaenh.dll
      0x76620000 - 0x766d6000 	C:\WINDOWS\system32\USERENV.dll
      0x597d0000 - 0x59825000 	C:\WINDOWS\system32\netapi32.dll
      0x49a80000 - 0x49ab6000 	C:\WINDOWS\system32\biolsp.dll
      0x77f40000 - 0x77fb6000 	C:\WINDOWS\system32\SHLWAPI.dll
      0x77a50000 - 0x77ae6000 	C:\WINDOWS\system32\CRYPT32.dll
      0x77af0000 - 0x77b02000 	C:\WINDOWS\system32\MSASN1.dll
      0x774b0000 - 0x775ee000 	C:\WINDOWS\system32\ole32.dll
      0x7e670000 - 0x7ee91000 	C:\WINDOWS\system32\SHELL32.dll
      0x770f0000 - 0x7717b000 	C:\WINDOWS\system32\OLEAUT32.dll
      0x773a0000 - 0x774a3000 	C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.2600.6028_x-ww_61e65202\comctl32.dll
      0x49ba0000 - 0x49bb9000 	C:\WINDOWS\system32\avsda.dll
      0x719f0000 - 0x719f8000 	C:\WINDOWS\System32\wshtcpip.dll
      0x6d6d0000 - 0x6d6d9000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\nio.dll
      0x6d7a0000 - 0x6d7a6000 	C:\Programme\Java\jdk1.6.0_23\jre\bin\rmi.dll
      
      VM Arguments:
      jvm_args: -ea -Xms256M -Xmx1G -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -Dcom.sun.management.jmxremote.port=8081 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dlog4j.configuration=log4j-server.properties -Dlog4j.defaultInitOverride=true -Dcassandra -Dcassandra-foreground=yes 
      java_command: org.apache.cassandra.thrift.CassandraDaemon
      Launcher Type: SUN_STANDARD
      
      Environment Variables:
      JAVA_HOME=C:\Programme\Java\jdk1.6.0_23\
      CLASSPATH=C:\TEMP\cassandra-0.7.2-1\bin\..\conf;"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\antlr-3.1.3.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\apache-cassandra-0.7.2.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\avro-1.4.0-fixes.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\avro-1.4.0-sources-fixes.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\commons-cli-1.1.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\commons-codec-1.2.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\commons-collections-3.2.1.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\commons-lang-2.4.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\concurrentlinkedhashmap-lru-1.1.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\guava-r05.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\high-scale-lib.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\jackson-core-asl-1.4.0.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\jackson-mapper-asl-1.4.0.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\jetty-6.1.21.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\jetty-util-6.1.21.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\jline-0.9.94.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\json-simple-1.1.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\jug-2.0.0.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\libthrift-0.5.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\log4j-1.2.16.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\servlet-api-2.5-20081211.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\slf4j-api-1.6.1.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\slf4j-log4j12-1.6.1.jar";"C:\TEMP\cassandra-0.7.2-1\bin\..\lib\snakeyaml-1.6.jar"
      PATH=C:\Programme\NVIDIA Corporation\PhysX\Common;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\system32\wbem;c:\programme\mysql server 5.1\bin;c:\windows\system32\windowspowershell\v1.0;c:\programme\interactive intelligence\;C:\Programme\Mercurial\;C:\Programme\QuickTime\QTSystem\;C:\Programme\Java\jre6\bin;C:\Programme\Java\jdk1.6.0_22\bin;C:\Programme\OpenSSL\bin;C:\Dokumente und Einstellungen\matti\Eigene Dateien\Tools
      USERNAME=matti
      OS=Windows_NT
      PROCESSOR_IDENTIFIER=x86 Family 6 Model 23 Stepping 6, GenuineIntel
      
      
      
      ---------------  S Y S T E M  ---------------
      
      OS: Windows XP Build 2600 Service Pack 3
      
      CPU:total 2 (2 cores per cpu, 1 threads per core) family 6 model 23 stepping 6, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1
      
      Memory: 4k page, physical 3402380k(1046912k free), swap 5517036k(2222108k free)
      
      vm_info: Java HotSpot(TM) Client VM (19.0-b09) for windows-x86 JRE (1.6.0_23-b05), built on Nov 12 2010 15:00:43 by "java_re" with MS VC++ 7.1 (VS2003)
      
      time: Tue Feb 22 12:14:00 2011
      elapsed time: 17 seconds
      

      Output from starting up node2:

      C:\TEMP\cassandra-0.7.2-2>bin\cassandra -f
      Starting Cassandra Server
      INFO 12:14:00,031 Logging initialized
      INFO 12:14:00,047 Heap size: 266797056/1070399488
      INFO 12:14:00,047 JNA not found. Native methods will be disabled.
      INFO 12:14:00,047 Loading settings from file:/C:/TEMP/cassandra-0.7.2-2/conf/cassandra.yaml
      DEBUG 12:14:00,110 Syncing log with a period of 10000
      INFO 12:14:00,110 DiskAccessMode 'auto' determined to be standard, indexAccessMode is standard
      DEBUG 12:14:00,156 setting auto_bootstrap to true
      INFO 12:14:00,156 Creating new commitlog segment /tmp/cassandra2/commitlog\CommitLog-1298373240156.log
      DEBUG 12:14:00,188 Initializing system.IndexInfo
      DEBUG 12:14:00,188 Starting CFS IndexInfo
      DEBUG 12:14:00,203 key cache capacity for IndexInfo is 1
      DEBUG 12:14:00,203 row cache capacity for IndexInfo is 0
      DEBUG 12:14:00,203 Initializing system.Schema
      DEBUG 12:14:00,203 Starting CFS Schema
      DEBUG 12:14:00,203 key cache capacity for Schema is 1
      DEBUG 12:14:00,203 row cache capacity for Schema is 0
      DEBUG 12:14:00,203 Initializing system.Migrations
      DEBUG 12:14:00,203 Starting CFS Migrations
      DEBUG 12:14:00,203 key cache capacity for Migrations is 1
      DEBUG 12:14:00,203 row cache capacity for Migrations is 0
      DEBUG 12:14:00,203 Initializing system.LocationInfo
      DEBUG 12:14:00,203 Starting CFS LocationInfo
      DEBUG 12:14:00,203 key cache capacity for LocationInfo is 1
      DEBUG 12:14:00,203 row cache capacity for LocationInfo is 0
      DEBUG 12:14:00,203 Initializing system.HintsColumnFamily
      DEBUG 12:14:00,203 Starting CFS HintsColumnFamily
      DEBUG 12:14:00,203 key cache capacity for HintsColumnFamily is 1
      DEBUG 12:14:00,203 row cache capacity for HintsColumnFamily is 0
      DEBUG 12:14:00,219 applying mutation of row 4c
      INFO 12:14:00,235 Couldn't detect any schema definitions in local storage.
      INFO 12:14:00,235 Found table data in data directories. Consider using JMX to call org.apache.cassandra.service.StorageServi
      ce.loadSchemaFromYaml().
      DEBUG 12:14:00,235 opening keyspace system
      INFO 12:14:00,235 No commitlog files found; skipping replay
      DEBUG 12:14:00,250 Estimating compactions for LocationInfo
      INFO 12:14:00,250 Upgrading to 0.7. Purging hints if there are any. Old hints will be snapshotted.
      DEBUG 12:14:00,250 Estimating compactions for HintsColumnFamily
      DEBUG 12:14:00,250 Estimating compactions for Migrations
      DEBUG 12:14:00,250 Estimating compactions for Schema
      DEBUG 12:14:00,250 Estimating compactions for IndexInfo
      DEBUG 12:14:00,250 Checking to see if compaction of LocationInfo would be useful
      DEBUG 12:14:00,250 Checking to see if compaction of HintsColumnFamily would be useful
      DEBUG 12:14:00,250 Checking to see if compaction of Migrations would be useful
      DEBUG 12:14:00,250 Checking to see if compaction of Schema would be useful
      DEBUG 12:14:00,250 Checking to see if compaction of IndexInfo would be useful
      DEBUG 12:14:00,250 applying mutation of row 436f6f6b696573
      INFO 12:14:00,250 Cassandra version: 0.7.2
      INFO 12:14:00,250 Thrift API version: 19.4.0
      INFO 12:14:00,250 Loading persisted ring state
      INFO 12:14:00,250 Starting up server gossip
      DEBUG 12:14:00,250 applying mutation of row 4c
      INFO 12:14:00,250 switching in a fresh Memtable for LocationInfo at CommitLogContext(file='C:\tmp\cassandra2\commitlog\Commi
      tLog-1298373240156.log', position=700)
      INFO 12:14:00,250 Enqueuing flush of Memtable-LocationInfo@540190(227 bytes, 4 operations)
      INFO 12:14:00,250 Writing Memtable-LocationInfo@540190(227 bytes, 4 operations)
      INFO 12:14:00,391 Completed flushing \tmp\cassandra2\data\system\LocationInfo-f-1-Data.db (335 bytes)
      DEBUG 12:14:00,391 adding \tmp\cassandra2\data\system\LocationInfo-f-1 to list of files tracked for system.LocationInfo
      DEBUG 12:14:00,391 Checking to see if compaction of LocationInfo would be useful
      DEBUG 12:14:00,391 discard completed log segments for CommitLogContext(file='C:\tmp\cassandra2\commitlog\CommitLog-1298373240
      156.log', position=700), column family 0.
      DEBUG 12:14:00,391 Marking replay position 700 on commit log CommitLogSegment(C:\tmp\cassandra2\commitlog\CommitLog-129837324
      0156.log)
      DEBUG 12:14:00,406 attempting to connect to /10.0.0.1
      DEBUG 12:14:00,406 Announcing my schema is 00000000-0000-1000-0000-000000000000
      DEBUG 12:14:00,406 Created HHOM instance, registered MBean.
      INFO 12:14:00,406 Joining: getting load information
      INFO 12:14:00,406 Sleeping 90000 ms to wait for load information...
      DEBUG 12:14:01,235 GC for ParNew: 6 ms, 12385208 reclaimed leaving 9676968 used; max is 1171062784
      DEBUG 12:14:01,235 GC for ConcurrentMarkSweep: 0 ms, 0 reclaimed leaving 0 used; max is 0
      DEBUG 12:14:01,406 attempting to connect to /10.0.0.1
      DEBUG 12:14:02,406 Disseminating load info ...
      DEBUG 12:14:12,422 attempting to connect to /10.0.0.1
      DEBUG 12:14:23,438 attempting to connect to /10.0.0.1
      DEBUG 12:14:34,453 attempting to connect to /10.0.0.1
      DEBUG 12:14:46,469 attempting to connect to /10.0.0.1
      DEBUG 12:14:57,500 attempting to connect to /10.0.0.1
      DEBUG 12:15:02,406 Disseminating load info ...
      DEBUG 12:15:08,516 attempting to connect to /10.0.0.1
      DEBUG 12:15:19,531 attempting to connect to /10.0.0.1
      DEBUG 12:15:30,375 GC for ParNew: 8 ms, 12524896 reclaimed leaving 78960264 used; max is 1171062784
      DEBUG 12:15:30,406 ... got load info
      INFO 12:15:30,406 Joining: getting bootstrap token
      ERROR 12:15:30,406 Exception encountered during startup.
      java.lang.RuntimeException: No other nodes seen! Unable to bootstrap
      at org.apache.cassandra.dht.BootStrapper.getBootstrapSource(BootStrapper.java:164)
      at org.apache.cassandra.dht.BootStrapper.getBalancedToken(BootStrapper.java:146)
      at org.apache.cassandra.dht.BootStrapper.getBootstrapToken(BootStrapper.java:141)
      at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:440)
      at org.apache.cassandra.service.StorageService.initServer(StorageService.java:394)
      at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:194)
      at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:316)
      at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
      Exception encountered during startup.
      java.lang.RuntimeException: No other nodes seen! Unable to bootstrap
      at org.apache.cassandra.dht.BootStrapper.getBootstrapSource(BootStrapper.java:164)
      at org.apache.cassandra.dht.BootStrapper.getBalancedToken(BootStrapper.java:146)
      at org.apache.cassandra.dht.BootStrapper.getBootstrapToken(BootStrapper.java:141)
      at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:440)
      at org.apache.cassandra.service.StorageService.initServer(StorageService.java:394)
      at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:194)
      at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:316)
      at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)

      Attachments

        Activity

          People

            Unassigned Unassigned
            tapter Matthias Keller
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: