Details
-
Improvement
-
Status: Resolved
-
Normal
-
Resolution: Fixed
Description
This looks like something fundamentally wrong with the sstable_generation_loading_test.py dtest - 1.2 and 2.0 look like:
$ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 sstable_generation_loading_test.py nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$'] incompressible_data_in_compressed_table_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-sJDYKB ok remove_index_file_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-gRTcgb Created keyspaces. Sleeping 1s for propagation. total,interval_op_rate,interval_key_rate,latency/95th/99.9th,elapsed_time 10000,1000,1000,11.5,80.3,280.6,5 END ok sstableloader_compression_deflate_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-xneocV Testing sstableloader with pre_compression=Deflate and post_compression=Deflate creating keyspace and inserting Making a copy of the sstables Wiping out the data and restarting cluster re-creating the keyspace and column families. Calling sstableloader No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]Reading data back FAIL sstableloader_compression_deflate_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-_iJ1tD Testing sstableloader with pre_compression=Deflate and post_compression=None creating keyspace and inserting Making a copy of the sstables Wiping out the data and restarting cluster re-creating the keyspace and column families. Calling sstableloader No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]Reading data back FAIL sstableloader_compression_deflate_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-FZAci9 Testing sstableloader with pre_compression=Deflate and post_compression=Snappy creating keyspace and inserting Making a copy of the sstables Wiping out the data and restarting cluster re-creating the keyspace and column families. Calling sstableloader No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]Reading data back FAIL sstableloader_compression_none_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-AsoepN Testing sstableloader with pre_compression=None and post_compression=Deflate creating keyspace and inserting Making a copy of the sstables Wiping out the data and restarting cluster re-creating the keyspace and column families. Calling sstableloader No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]Reading data back FAIL sstableloader_compression_none_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-Cfiwh8 Testing sstableloader with pre_compression=None and post_compression=None creating keyspace and inserting Making a copy of the sstables Wiping out the data and restarting cluster re-creating the keyspace and column families. Calling sstableloader No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]Reading data back FAIL sstableloader_compression_none_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-tTuQQg Testing sstableloader with pre_compression=None and post_compression=Snappy creating keyspace and inserting Making a copy of the sstables Wiping out the data and restarting cluster re-creating the keyspace and column families. Calling sstableloader No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]Reading data back FAIL sstableloader_compression_snappy_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-lA0rXi Testing sstableloader with pre_compression=Snappy and post_compression=Deflate creating keyspace and inserting Making a copy of the sstables Wiping out the data and restarting cluster re-creating the keyspace and column families. Calling sstableloader No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]Reading data back FAIL sstableloader_compression_snappy_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-jJ5iub Testing sstableloader with pre_compression=Snappy and post_compression=None creating keyspace and inserting Making a copy of the sstables Wiping out the data and restarting cluster re-creating the keyspace and column families. Calling sstableloader No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]Reading data back FAIL sstableloader_compression_snappy_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-JTMBKg Testing sstableloader with pre_compression=Snappy and post_compression=Snappy creating keyspace and inserting Making a copy of the sstables Wiping out the data and restarting cluster re-creating the keyspace and column families. Calling sstableloader No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]No sstables to stream progress: [total: 100 - 0MB/s (avg: 0MB/s)]Reading data back FAIL ====================================================================== FAIL: sstableloader_compression_deflate_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 108, in sstableloader_compression_deflate_to_deflate_test self.load_sstable_with_configuration('Deflate', 'Deflate') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 197, in load_sstable_with_configuration read_and_validate_data(cursor) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 190, in read_and_validate_data self.assertEquals([str(i), 'col', str(i)], cursor.fetchone()) AssertionError: ['0', 'col', '0'] != None ====================================================================== FAIL: sstableloader_compression_deflate_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 102, in sstableloader_compression_deflate_to_none_test self.load_sstable_with_configuration('Deflate', None) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 197, in load_sstable_with_configuration read_and_validate_data(cursor) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 190, in read_and_validate_data self.assertEquals([str(i), 'col', str(i)], cursor.fetchone()) AssertionError: ['0', 'col', '0'] != None ====================================================================== FAIL: sstableloader_compression_deflate_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 105, in sstableloader_compression_deflate_to_snappy_test self.load_sstable_with_configuration('Deflate', 'Snappy') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 197, in load_sstable_with_configuration read_and_validate_data(cursor) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 190, in read_and_validate_data self.assertEquals([str(i), 'col', str(i)], cursor.fetchone()) AssertionError: ['0', 'col', '0'] != None ====================================================================== FAIL: sstableloader_compression_none_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 90, in sstableloader_compression_none_to_deflate_test self.load_sstable_with_configuration(None, 'Deflate') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 197, in load_sstable_with_configuration read_and_validate_data(cursor) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 190, in read_and_validate_data self.assertEquals([str(i), 'col', str(i)], cursor.fetchone()) AssertionError: ['0', 'col', '0'] != None ====================================================================== FAIL: sstableloader_compression_none_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 84, in sstableloader_compression_none_to_none_test self.load_sstable_with_configuration(None, None) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 197, in load_sstable_with_configuration read_and_validate_data(cursor) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 190, in read_and_validate_data self.assertEquals([str(i), 'col', str(i)], cursor.fetchone()) AssertionError: ['0', 'col', '0'] != None ====================================================================== FAIL: sstableloader_compression_none_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 87, in sstableloader_compression_none_to_snappy_test self.load_sstable_with_configuration(None, 'Snappy') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 197, in load_sstable_with_configuration read_and_validate_data(cursor) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 190, in read_and_validate_data self.assertEquals([str(i), 'col', str(i)], cursor.fetchone()) AssertionError: ['0', 'col', '0'] != None ====================================================================== FAIL: sstableloader_compression_snappy_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 99, in sstableloader_compression_snappy_to_deflate_test self.load_sstable_with_configuration('Snappy', 'Deflate') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 197, in load_sstable_with_configuration read_and_validate_data(cursor) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 190, in read_and_validate_data self.assertEquals([str(i), 'col', str(i)], cursor.fetchone()) AssertionError: ['0', 'col', '0'] != None ====================================================================== FAIL: sstableloader_compression_snappy_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 93, in sstableloader_compression_snappy_to_none_test self.load_sstable_with_configuration('Snappy', None) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 197, in load_sstable_with_configuration read_and_validate_data(cursor) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 190, in read_and_validate_data self.assertEquals([str(i), 'col', str(i)], cursor.fetchone()) AssertionError: ['0', 'col', '0'] != None ====================================================================== FAIL: sstableloader_compression_snappy_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 96, in sstableloader_compression_snappy_to_snappy_test self.load_sstable_with_configuration('Snappy', 'Snappy') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 197, in load_sstable_with_configuration read_and_validate_data(cursor) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 190, in read_and_validate_data self.assertEquals([str(i), 'col', str(i)], cursor.fetchone()) AssertionError: ['0', 'col', '0'] != None ---------------------------------------------------------------------- Ran 11 tests in 336.704s FAILED (failures=9)
2.1 looks like:
$ export MAX_HEAP_SIZE="1G"; export HEAP_NEWSIZE="256M"; PRINT_DEBUG=true nosetests --nocapture --nologcapture --verbosity=3 sstable_generation_loading_test.py nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$'] incompressible_data_in_compressed_table_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-gPkstl [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR remove_index_file_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-Vx3Bsj [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR sstableloader_compression_deflate_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-Ap0VwZ Testing sstableloader with pre_compression=Deflate and post_compression=Deflate [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) [node2 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node2 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node2 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node2 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node2 ERROR] ... 8 more [node2 ERROR] Caused by: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node2 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node2 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node2 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node2 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node2 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node2 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node2 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR sstableloader_compression_deflate_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-Nsy44b Testing sstableloader with pre_compression=Deflate and post_compression=None [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) [node2 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node2 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node2 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node2 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node2 ERROR] ... 8 more [node2 ERROR] Caused by: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node2 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node2 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node2 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node2 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node2 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node2 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node2 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR sstableloader_compression_deflate_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-77_xIH Testing sstableloader with pre_compression=Deflate and post_compression=Snappy [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) [node2 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node2 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node2 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node2 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node2 ERROR] ... 8 more [node2 ERROR] Caused by: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node2 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node2 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node2 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node2 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node2 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node2 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node2 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR sstableloader_compression_none_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-x3esB0 Testing sstableloader with pre_compression=None and post_compression=Deflate [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) [node2 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node2 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node2 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node2 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node2 ERROR] ... 8 more [node2 ERROR] Caused by: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node2 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node2 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node2 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node2 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node2 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node2 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node2 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR sstableloader_compression_none_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-HgJni9 Testing sstableloader with pre_compression=None and post_compression=None [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) [node2 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node2 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node2 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node2 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node2 ERROR] ... 8 more [node2 ERROR] Caused by: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node2 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node2 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node2 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node2 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node2 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node2 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node2 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR sstableloader_compression_none_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-QkUEf5 Testing sstableloader with pre_compression=None and post_compression=Snappy [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) [node2 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node2 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node2 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node2 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node2 ERROR] ... 8 more [node2 ERROR] Caused by: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node2 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node2 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node2 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node2 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node2 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node2 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node2 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR sstableloader_compression_snappy_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-mgv9zG Testing sstableloader with pre_compression=Snappy and post_compression=Deflate [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) [node2 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node2 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node2 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node2 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node2 ERROR] ... 8 more [node2 ERROR] Caused by: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node2 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node2 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node2 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node2 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node2 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node2 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node2 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR sstableloader_compression_snappy_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-e0mEVq Testing sstableloader with pre_compression=Snappy and post_compression=None [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) [node2 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node2 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node2 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node2 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node2 ERROR] ... 8 more [node2 ERROR] Caused by: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node2 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node2 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node2 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node2 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node2 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node2 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node2 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR sstableloader_compression_snappy_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ... cluster ccm directory: /tmp/dtest-x3D6Bu Testing sstableloader with pre_compression=Snappy and post_compression=Snappy [node1 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node1 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node1 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node1 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node1 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node1 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node1 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node1 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node1 ERROR] ... 8 more [node1 ERROR] Caused by: java.lang.AssertionError [node1 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node1 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node1 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node1 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node1 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node1 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node1 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node1 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node1 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node1 ERROR] at java.lang.Thread.run(Thread.java:744) [node2 ERROR] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) [node2 ERROR] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) [node2 ERROR] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [node2 ERROR] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [node2 ERROR] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError [node2 ERROR] at java.util.concurrent.FutureTask.report(FutureTask.java:122) [node2 ERROR] at java.util.concurrent.FutureTask.get(FutureTask.java:188) [node2 ERROR] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) [node2 ERROR] ... 8 more [node2 ERROR] Caused by: java.lang.AssertionError [node2 ERROR] at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) [node2 ERROR] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) [node2 ERROR] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) [node2 ERROR] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) [node2 ERROR] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) [node2 ERROR] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) [node2 ERROR] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [node2 ERROR] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [node2 ERROR] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [node2 ERROR] at java.lang.Thread.run(Thread.java:744) ERROR ====================================================================== ERROR: incompressible_data_in_compressed_table_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 25, in incompressible_data_in_compressed_table_test cluster.populate(1).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: remove_index_file_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 55, in remove_index_file_test cluster.populate(1).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: sstableloader_compression_deflate_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 108, in sstableloader_compression_deflate_to_deflate_test self.load_sstable_with_configuration('Deflate', 'Deflate') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 127, in load_sstable_with_configuration cluster.populate(2).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: sstableloader_compression_deflate_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 102, in sstableloader_compression_deflate_to_none_test self.load_sstable_with_configuration('Deflate', None) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 127, in load_sstable_with_configuration cluster.populate(2).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: sstableloader_compression_deflate_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 105, in sstableloader_compression_deflate_to_snappy_test self.load_sstable_with_configuration('Deflate', 'Snappy') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 127, in load_sstable_with_configuration cluster.populate(2).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: sstableloader_compression_none_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 90, in sstableloader_compression_none_to_deflate_test self.load_sstable_with_configuration(None, 'Deflate') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 127, in load_sstable_with_configuration cluster.populate(2).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: sstableloader_compression_none_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 84, in sstableloader_compression_none_to_none_test self.load_sstable_with_configuration(None, None) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 127, in load_sstable_with_configuration cluster.populate(2).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: sstableloader_compression_none_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 87, in sstableloader_compression_none_to_snappy_test self.load_sstable_with_configuration(None, 'Snappy') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 127, in load_sstable_with_configuration cluster.populate(2).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: sstableloader_compression_snappy_to_deflate_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 99, in sstableloader_compression_snappy_to_deflate_test self.load_sstable_with_configuration('Snappy', 'Deflate') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 127, in load_sstable_with_configuration cluster.populate(2).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: sstableloader_compression_snappy_to_none_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 93, in sstableloader_compression_snappy_to_none_test self.load_sstable_with_configuration('Snappy', None) File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 127, in load_sstable_with_configuration cluster.populate(2).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ====================================================================== ERROR: sstableloader_compression_snappy_to_snappy_test (sstable_generation_loading_test.TestSSTableGenerationAndLoading) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 96, in sstableloader_compression_snappy_to_snappy_test self.load_sstable_with_configuration('Snappy', 'Snappy') File "/home/mshuler/git/cassandra-dtest/sstable_generation_loading_test.py", line 127, in load_sstable_with_configuration cluster.populate(2).start() File "/home/mshuler/git/ccm/ccmlib/cluster.py", line 230, in start raise NodeError("Error starting {0}.".format(node.name), p) NodeError: Error starting node1. ---------------------------------------------------------------------- Ran 11 tests in 56.599s FAILED (errors=11)
2.1 last ccm node1 log (node2 is the same):
INFO [main] 2014-04-08 19:20:33,339 CassandraDaemon.java:102 - Hostname: hana.12.am INFO [main] 2014-04-08 19:20:33,396 YamlConfigurationLoader.java:80 - Loading settings from file:/tmp/dtest-x3D6Bu/test/node1/conf/cassandra.yaml INFO [main] 2014-04-08 19:20:33,514 YamlConfigurationLoader.java:123 - Node configuration:[authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=false; auto_snapshot=true; batchlog_replay_throttle_in_kb=1024; cas_contention_timeout_in_ms=1000; client_encryption_options=<REDACTED>; cluster_name=test; column_index_size_in_kb=64; commitlog_directory=/tmp/dtest-x3D6Bu/test/node1/commitlogs; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_period_in_ms=10000; compaction_preheat_key_cache=true; compaction_throughput_mb_per_sec=16; concurrent_counter_writes=32; concurrent_reads=32; concurrent_writes=32; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; cross_node_timeout=false; data_file_directories=[/tmp/dtest-x3D6Bu/test/node1/data]; disk_failure_policy=stop; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; endpoint_snitch=SimpleSnitch; flush_directory=/tmp/dtest-x3D6Bu/test/node1/flush; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; in_memory_compaction_limit_in_mb=64; incremental_backups=false; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=-9223372036854775808; inter_dc_tcp_nodelay=false; internode_compression=all; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=127.0.0.1; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=0.4; native_transport_port=9042; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_validity_in_ms=2000; phi_convict_threshold=5; preheat_kernel_page_cache=false; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=10000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_timeout_in_ms=10000; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=127.0.0.1; rpc_keepalive=true; rpc_port=9160; rpc_server_type=sync; saved_caches_directory=/tmp/dtest-x3D6Bu/test/node1/saved_caches; seed_provider=[{class_name=org.apache.cassandra.locator.SimpleSeedProvider, parameters=[{seeds=127.0.0.1}]}]; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; start_native_transport=true; start_rpc=true; storage_port=7000; thrift_framed_transport_size_in_mb=15; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=10000; write_request_timeout_in_ms=10000] INFO [main] 2014-04-08 19:20:33,740 DatabaseDescriptor.java:197 - DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap INFO [main] 2014-04-08 19:20:33,746 DatabaseDescriptor.java:285 - Global memtable on-heap threshold is enabled at 249MB INFO [main] 2014-04-08 19:20:33,747 DatabaseDescriptor.java:289 - Global memtable off-heap threshold is enabled at 249MB INFO [main] 2014-04-08 19:20:34,141 CassandraDaemon.java:113 - JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.7.0_51 INFO [main] 2014-04-08 19:20:34,141 CassandraDaemon.java:141 - Heap size: 1046937600/1046937600 INFO [main] 2014-04-08 19:20:34,141 CassandraDaemon.java:143 - Code Cache Non-heap memory: init = 2555904(2496K) used = 675712(659K) committed = 2555904(2496K) max = 50331648(49152K) INFO [main] 2014-04-08 19:20:34,142 CassandraDaemon.java:143 - Par Eden Space Heap memory: init = 214827008(209792K) used = 81668768(79754K) committed = 214827008(209792K) max = 214827008(209792K) INFO [main] 2014-04-08 19:20:34,142 CassandraDaemon.java:143 - Par Survivor Space Heap memory: init = 26804224(26176K) used = 0(0K) committed = 26804224(26176K) max = 26804224(26176K) INFO [main] 2014-04-08 19:20:34,142 CassandraDaemon.java:143 - CMS Old Gen Heap memory: init = 805306368(786432K) used = 0(0K) committed = 805306368(786432K) max = 805306368(786432K) INFO [main] 2014-04-08 19:20:34,142 CassandraDaemon.java:143 - CMS Perm Gen Non-heap memory: init = 21757952(21248K) used = 16716776(16324K) committed = 21757952(21248K) max = 85983232(83968K) INFO [main] 2014-04-08 19:20:34,143 CassandraDaemon.java:144 - Classpath: /home/mshuler/git/cassandra/build/cobertura/classes:/tmp/dtest-x3D6Bu/test/node1/conf:/home/mshuler/git/cassandra/build/classes/main:/home/mshuler/git/cassandra/build/classes/thrift:/home/mshuler/git/cassandra/lib/airline-0.6.jar:/home/mshuler/git/cassandra/lib/antlr-3.2.jar:/home/mshuler/git/cassandra/lib/commons-cli-1.1.jar:/home/mshuler/git/cassandra/lib/commons-codec-1.2.jar:/home/mshuler/git/cassandra/lib/commons-lang3-3.1.jar:/home/mshuler/git/cassandra/lib/commons-math3-3.2.jar:/home/mshuler/git/cassandra/lib/compress-lzf-0.8.4.jar:/home/mshuler/git/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/home/mshuler/git/cassandra/lib/disruptor-3.0.1.jar:/home/mshuler/git/cassandra/lib/guava-16.0.jar:/home/mshuler/git/cassandra/lib/high-scale-lib-1.1.2.jar:/home/mshuler/git/cassandra/lib/jackson-core-asl-1.9.2.jar:/home/mshuler/git/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/home/mshuler/git/cassandra/lib/jamm-0.2.6.jar:/home/mshuler/git/cassandra/lib/javax.inject.jar:/home/mshuler/git/cassandra/lib/jbcrypt-0.3m.jar:/home/mshuler/git/cassandra/lib/jline-1.0.jar:/home/mshuler/git/cassandra/lib/jna-4.0.0.jar:/home/mshuler/git/cassandra/lib/json-simple-1.1.jar:/home/mshuler/git/cassandra/lib/libthrift-0.9.1.jar:/home/mshuler/git/cassandra/lib/logback-classic-1.1.2.jar:/home/mshuler/git/cassandra/lib/logback-core-1.1.12.jar:/home/mshuler/git/cassandra/lib/lz4-1.2.0.jar:/home/mshuler/git/cassandra/lib/metrics-core-2.2.0.jar:/home/mshuler/git/cassandra/lib/netty-all-4.0.17.Final.jar:/home/mshuler/git/cassandra/lib/reporter-config-2.1.0.jar:/home/mshuler/git/cassandra/lib/slf4j-api-1.7.2.jar:/home/mshuler/git/cassandra/lib/snakeyaml-1.11.jar:/home/mshuler/git/cassandra/lib/snappy-java-1.0.5.jar:/home/mshuler/git/cassandra/lib/stream-2.5.2.jar:/home/mshuler/git/cassandra/lib/super-csv-2.1.0.jar:/home/mshuler/git/cassandra/lib/thrift-server-0.3.3.jar:/home/mshuler/.m2/repository/net/sourceforge/cobertura/cobertura/1.9.4.1/cobertura-1.9.4.1.jar:/home/mshuler/git/cassandra/lib/jamm-0.2.6.jar WARN [main] 2014-04-08 19:20:34,204 CLibrary.java:130 - Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out, especially with mmapped I/O enabled. Increase RLIMIT_MEMLOCK or run Cassandra as root. INFO [main] 2014-04-08 19:20:34,227 CacheService.java:111 - Initializing key cache with capacity of 49 MBs. INFO [main] 2014-04-08 19:20:34,237 CacheService.java:133 - Initializing row cache with capacity of 0 MBs INFO [main] 2014-04-08 19:20:34,244 CacheService.java:150 - Initializing counter cache with capacity of 24 MBs INFO [main] 2014-04-08 19:20:34,246 CacheService.java:161 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [main] 2014-04-08 19:20:34,360 ColumnFamilyStore.java:283 - Initializing system.schema_triggers INFO [main] 2014-04-08 19:20:35,608 ColumnFamilyStore.java:283 - Initializing system.compaction_history INFO [main] 2014-04-08 19:20:35,618 ColumnFamilyStore.java:283 - Initializing system.batchlog INFO [main] 2014-04-08 19:20:35,624 ColumnFamilyStore.java:283 - Initializing system.sstable_activity INFO [main] 2014-04-08 19:20:35,630 ColumnFamilyStore.java:283 - Initializing system.peer_events INFO [main] 2014-04-08 19:20:35,643 ColumnFamilyStore.java:283 - Initializing system.compactions_in_progress INFO [main] 2014-04-08 19:20:35,652 ColumnFamilyStore.java:283 - Initializing system.hints INFO [main] 2014-04-08 19:20:35,656 ColumnFamilyStore.java:283 - Initializing system.schema_keyspaces INFO [main] 2014-04-08 19:20:35,660 ColumnFamilyStore.java:283 - Initializing system.range_xfers INFO [main] 2014-04-08 19:20:35,664 ColumnFamilyStore.java:283 - Initializing system.schema_columnfamilies INFO [main] 2014-04-08 19:20:35,669 ColumnFamilyStore.java:283 - Initializing system.NodeIdInfo INFO [main] 2014-04-08 19:20:35,677 ColumnFamilyStore.java:283 - Initializing system.paxos INFO [main] 2014-04-08 19:20:35,682 ColumnFamilyStore.java:283 - Initializing system.schema_usertypes INFO [main] 2014-04-08 19:20:35,686 ColumnFamilyStore.java:283 - Initializing system.schema_columns INFO [main] 2014-04-08 19:20:35,691 ColumnFamilyStore.java:283 - Initializing system.IndexInfo INFO [main] 2014-04-08 19:20:35,695 ColumnFamilyStore.java:283 - Initializing system.peers INFO [main] 2014-04-08 19:20:35,700 ColumnFamilyStore.java:283 - Initializing system.local INFO [main] 2014-04-08 19:20:35,820 DatabaseDescriptor.java:587 - Couldn't detect any schema definitions in local storage. INFO [main] 2014-04-08 19:20:35,821 DatabaseDescriptor.java:592 - To create keyspaces and column families, see 'help create' in cqlsh. INFO [main] 2014-04-08 19:20:35,903 ColumnFamilyStore.java:853 - Enqueuing flush of local: 1109 (0%) on-heap, 0 (0%) off-heap INFO [MemtableFlushWriter:1] 2014-04-08 19:20:35,921 Memtable.java:344 - Writing Memtable-local@1878619947(220 serialized bytes, 5 ops, 0%/0% of on/off-heap limit) INFO [MemtableFlushWriter:1] 2014-04-08 19:20:36,021 Memtable.java:378 - Completed flushing /tmp/dtest-x3D6Bu/test/node1/flush/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-1-Data.db (171 bytes) for commitlog position ReplayPosition(segmentId=1397002835560, position=403) INFO [main] 2014-04-08 19:20:36,038 CommitLog.java:108 - No commitlog files found; skipping replay INFO [main] 2014-04-08 19:20:36,535 StorageService.java:510 - Cassandra version: 2.1.0-beta1-SNAPSHOT INFO [main] 2014-04-08 19:20:36,535 StorageService.java:511 - Thrift API version: 19.39.0 INFO [main] 2014-04-08 19:20:36,559 StorageService.java:512 - CQL supported versions: 2.0.0,3.1.5 (default: 3.1.5) INFO [main] 2014-04-08 19:20:36,595 IndexSummaryManager.java:99 - Initializing index summary manager with a memory pool size of 49 MB and a resize interval of 60 minutes INFO [main] 2014-04-08 19:20:36,607 StorageService.java:537 - Loading persisted ring state INFO [main] 2014-04-08 19:20:36,679 StorageService.java:858 - Saved tokens not found. Using configuration value: [-9223372036854775808] INFO [main] 2014-04-08 19:20:36,701 MigrationManager.java:206 - Create new Keyspace: KSMetaData{name=system_traces, strategyClass=SimpleStrategy, strategyOptions={replication_factor=2}, cfMetaData={sessions=org.apache.cassandra.config.CFMetaData@7892cf41[cfId=c5e99f16-8677-3914-b17e-960613512345,ksName=system_traces,cfName=sessions,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.ColumnToCollectionType(706172616d6574657273:org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type))),comment=traced sessions,readRepairChance=0.0,dclocalReadRepairChance=0.0,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,columnMetadata={java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=session_id, type=org.apache.cassandra.db.marshal.UUIDType, kind=PARTITION_KEY, componentIndex=null, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=duration, type=org.apache.cassandra.db.marshal.Int32Type, kind=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=parameters, type=org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type), kind=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=started_at, type=org.apache.cassandra.db.marshal.TimestampType, kind=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=7 cap=7]=ColumnDefinition{name=request, type=org.apache.cassandra.db.marshal.UTF8Type, kind=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=11 cap=11]=ColumnDefinition{name=coordinator, type=org.apache.cassandra.db.marshal.InetAddressType, kind=REGULAR, componentIndex=0, indexName=null, indexType=null}},compactionStrategyClass=class org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionParameters={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtableFlushPeriod=3600000,caching={"keys":"ALL", "rows_per_partition":"NONE"},defaultTimeToLive=0,minIndexInterval=128,maxIndexInterval=2048,speculativeRetry=99.0PERCENTILE,populateIoCacheOnFlush=false,droppedColumns={},triggers={}], events=org.apache.cassandra.config.CFMetaData@3a437a40[cfId=8826e8e9-e16a-3728-8753-3bc1fc713c25,ksName=system_traces,cfName=events,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.TimeUUIDType,org.apache.cassandra.db.marshal.UTF8Type),comment=,readRepairChance=0.0,dclocalReadRepairChance=0.0,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,columnMetadata={java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=session_id, type=org.apache.cassandra.db.marshal.UUIDType, kind=PARTITION_KEY, componentIndex=null, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=source, type=org.apache.cassandra.db.marshal.InetAddressType, kind=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=thread, type=org.apache.cassandra.db.marshal.UTF8Type, kind=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=activity, type=org.apache.cassandra.db.marshal.UTF8Type, kind=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=14 cap=14]=ColumnDefinition{name=source_elapsed, type=org.apache.cassandra.db.marshal.Int32Type, kind=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=event_id, type=org.apache.cassandra.db.marshal.TimeUUIDType, kind=CLUSTERING_COLUMN, componentIndex=0, indexName=null, indexType=null}},compactionStrategyClass=class org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionParameters={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtableFlushPeriod=3600000,caching={"keys":"ALL", "rows_per_partition":"NONE"},defaultTimeToLive=0,minIndexInterval=128,maxIndexInterval=2048,speculativeRetry=99.0PERCENTILE,populateIoCacheOnFlush=false,droppedColumns={},triggers={}]}, durableWrites=true, userTypes=org.apache.cassandra.config.UTMetaData@240f1da2} INFO [MigrationStage:1] 2014-04-08 19:20:36,826 ColumnFamilyStore.java:853 - Enqueuing flush of schema_keyspaces: 990 (0%) on-heap, 0 (0%) off-heap INFO [MemtableFlushWriter:2] 2014-04-08 19:20:36,834 Memtable.java:344 - Writing Memtable-schema_keyspaces@2107075397(251 serialized bytes, 7 ops, 0%/0% of on/off-heap limit) INFO [MemtableFlushWriter:2] 2014-04-08 19:20:36,915 Memtable.java:378 - Completed flushing /tmp/dtest-x3D6Bu/test/node1/flush/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-1-Data.db (216 bytes) for commitlog position ReplayPosition(segmentId=1397002835560, position=99535) INFO [MigrationStage:1] 2014-04-08 19:20:36,920 ColumnFamilyStore.java:853 - Enqueuing flush of schema_columnfamilies: 164066 (0%) on-heap, 0 (0%) off-heap INFO [MemtableFlushWriter:1] 2014-04-08 19:20:36,921 Memtable.java:344 - Writing Memtable-schema_columnfamilies@1732384250(30202 serialized bytes, 514 ops, 0%/0% of on/off-heap limit) INFO [MemtableFlushWriter:1] 2014-04-08 19:20:37,019 Memtable.java:378 - Completed flushing /tmp/dtest-x3D6Bu/test/node1/flush/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-1-Data.db (6720 bytes) for commitlog position ReplayPosition(segmentId=1397002835560, position=99535) INFO [MigrationStage:1] 2014-04-08 19:20:37,033 ColumnFamilyStore.java:853 - Enqueuing flush of schema_columns: 288881 (0%) on-heap, 0 (0%) off-heap INFO [MemtableFlushWriter:2] 2014-04-08 19:20:37,034 Memtable.java:344 - Writing Memtable-schema_columns@985819426(46627 serialized bytes, 904 ops, 0%/0% of on/off-heap limit) INFO [MemtableFlushWriter:2] 2014-04-08 19:20:37,140 Memtable.java:378 - Completed flushing /tmp/dtest-x3D6Bu/test/node1/flush/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-1-Data.db (10835 bytes) for commitlog position ReplayPosition(segmentId=1397002835560, position=99535) INFO [MigrationStage:1] 2014-04-08 19:20:37,351 DefsTables.java:388 - Loading org.apache.cassandra.config.CFMetaData@40e9da6[cfId=c5e99f16-8677-3914-b17e-960613512345,ksName=system_traces,cfName=sessions,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.ColumnToCollectionType(706172616d6574657273:org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type))),comment=traced sessions,readRepairChance=0.0,dclocalReadRepairChance=0.0,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,columnMetadata={java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=duration, type=org.apache.cassandra.db.marshal.Int32Type, kind=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=session_id, type=org.apache.cassandra.db.marshal.UUIDType, kind=PARTITION_KEY, componentIndex=null, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=parameters, type=org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type), kind=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=started_at, type=org.apache.cassandra.db.marshal.TimestampType, kind=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=7 cap=7]=ColumnDefinition{name=request, type=org.apache.cassandra.db.marshal.UTF8Type, kind=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=11 cap=11]=ColumnDefinition{name=coordinator, type=org.apache.cassandra.db.marshal.InetAddressType, kind=REGULAR, componentIndex=0, indexName=null, indexType=null}},compactionStrategyClass=class org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionParameters={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtableFlushPeriod=3600000,caching={"keys":"ALL", "rows_per_partition":"NONE"},defaultTimeToLive=0,minIndexInterval=128,maxIndexInterval=2048,speculativeRetry=99.0PERCENTILE,populateIoCacheOnFlush=false,droppedColumns={},triggers={}] INFO [MigrationStage:1] 2014-04-08 19:20:37,357 ColumnFamilyStore.java:283 - Initializing system_traces.sessions INFO [MigrationStage:1] 2014-04-08 19:20:37,358 DefsTables.java:388 - Loading org.apache.cassandra.config.CFMetaData@5b8fff5e[cfId=8826e8e9-e16a-3728-8753-3bc1fc713c25,ksName=system_traces,cfName=events,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.TimeUUIDType,org.apache.cassandra.db.marshal.UTF8Type),comment=,readRepairChance=0.0,dclocalReadRepairChance=0.0,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,columnMetadata={java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=session_id, type=org.apache.cassandra.db.marshal.UUIDType, kind=PARTITION_KEY, componentIndex=null, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=source, type=org.apache.cassandra.db.marshal.InetAddressType, kind=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=thread, type=org.apache.cassandra.db.marshal.UTF8Type, kind=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=activity, type=org.apache.cassandra.db.marshal.UTF8Type, kind=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=14 cap=14]=ColumnDefinition{name=source_elapsed, type=org.apache.cassandra.db.marshal.Int32Type, kind=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=event_id, type=org.apache.cassandra.db.marshal.TimeUUIDType, kind=CLUSTERING_COLUMN, componentIndex=0, indexName=null, indexType=null}},compactionStrategyClass=class org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionParameters={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtableFlushPeriod=3600000,caching={"keys":"ALL", "rows_per_partition":"NONE"},defaultTimeToLive=0,minIndexInterval=128,maxIndexInterval=2048,speculativeRetry=99.0PERCENTILE,populateIoCacheOnFlush=false,droppedColumns={},triggers={}] INFO [MigrationStage:1] 2014-04-08 19:20:37,363 ColumnFamilyStore.java:283 - Initializing system_traces.events ERROR [MigrationStage:1] 2014-04-08 19:20:37,426 CassandraDaemon.java:166 - Exception in thread Thread[MigrationStage:1,5,main] java.lang.AssertionError: null at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) ~[main/:na] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) ~[main/:na] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) ~[main/:na] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) ~[main/:na] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) ~[main/:na] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[main/:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_51] at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_51] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_51] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_51] at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51] ERROR [main] 2014-04-08 19:20:37,427 CassandraDaemon.java:471 - Exception encountered during startup java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.AssertionError at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:411) ~[main/:na] at org.apache.cassandra.service.MigrationManager.announce(MigrationManager.java:298) ~[main/:na] at org.apache.cassandra.service.MigrationManager.announceNewKeyspace(MigrationManager.java:207) ~[main/:na] at org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:915) ~[main/:na] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:625) ~[main/:na] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:505) ~[main/:na] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:335) [main/:na] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:454) [main/:na] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:543) [main/:na] Caused by: java.util.concurrent.ExecutionException: java.lang.AssertionError at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[na:1.7.0_51] at java.util.concurrent.FutureTask.get(FutureTask.java:188) ~[na:1.7.0_51] at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:407) ~[main/:na] ... 8 common frames omitted Caused by: java.lang.AssertionError: null at org.apache.cassandra.gms.Gossiper.addLocalApplicationState(Gossiper.java:1256) ~[main/:na] at org.apache.cassandra.service.MigrationManager.passiveAnnounce(MigrationManager.java:340) ~[main/:na] at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:380) ~[main/:na] at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:188) ~[main/:na] at org.apache.cassandra.service.MigrationManager$2.runMayThrow(MigrationManager.java:316) ~[main/:na] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[main/:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_51] at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_51] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_51] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[na:1.7.0_51] at java.lang.Thread.run(Thread.java:744) ~[na:1.7.0_51] ERROR [StorageServiceShutdownHook] 2014-04-08 19:20:37,437 CassandraDaemon.java:166 - Exception in thread Thread[StorageServiceShutdownHook,5,main] java.lang.NullPointerException: null at org.apache.cassandra.gms.Gossiper.stop(Gossiper.java:1270) ~[main/:na] at org.apache.cassandra.service.StorageService$1.runMayThrow(StorageService.java:581) ~[main/:na] at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[main/:na] at java.lang.Thread.run(Thread.java:744) ~[na:1.7.0_51]