[CASSANDRA-12986] dtest failure in upgrade_internal_auth_test.TestAuthUpgrade.test_upgrade_legacy_table

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Auto Closed
• Component/s: Test/dtest/python
• Labels: dtest test-failure
• Severity: Normal
• Assignee: Sean McCarthy
• Reporter: Sean McCarthy

Authors

Sean McCarthy

• Created: 02/Dec/16 15:11
• Updated: 13/Sep/21 17:12
• Resolved: 13/Sep/21 17:12

Description

example failure:

http://cassci.datastax.com/job/trunk_dtest/1437/testReport/upgrade_internal_auth_test/TestAuthUpgrade/test_upgrade_legacy_table

Standard Output

Unexpected error in node1 log, error: 
ERROR [main] 2016-12-01 03:08:30,985 CassandraDaemon.java:724 - Detected unreadable sstables /tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-10-Data.db,/tmp/dtest-wwgdhU/test/node1/data1/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-9-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/system-schema_usertypes-ka-1-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-10-Data.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/system-schema_triggers-ka-1-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/system-schema_usertypes-ka-1-Summary.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-9-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-11-Index.db,/tmp/dtest-wwgdhU/test/node1/data1/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-6-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data1/system/peers-37f71aca7dc2383ba70672528af04d4f/system-peers-ka-1-Filter.db,/tmp/dtest-wwgdhU/test/node1/data1/system/peers-37f71aca7dc2383ba70672528af04d4f/system-peers-ka-1-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-10-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-10-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-13-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-10-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-5-Index.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-10-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-9-Index.db,/tmp/dtest-wwgdhU/test/node1/data1/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-6-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data2/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/system-sstable_activity-ka-1-Index.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-9-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data1/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-6-Summary.db,/tmp/dtest-wwgdhU/test/node1/data2/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/system-sstable_activity-ka-1-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-10-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/system-schema_usertypes-ka-1-Data.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-9-Data.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-13-Index.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/system-schema_triggers-ka-1-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data2/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/system-sstable_activity-ka-1-Filter.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-11-Index.db,/tmp/dtest-wwgdhU/test/node1/data1/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-6-Data.db,/tmp/dtest-wwgdhU/test/node1/data2/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/system-sstable_activity-ka-1-Data.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/system-schema_triggers-ka-1-Data.db,/tmp/dtest-wwgdhU/test/node1/data2/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/system-sstable_activity-ka-1-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/system-schema_triggers-ka-1-Index.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/system-schema_triggers-ka-1-Summary.db,/tmp/dtest-wwgdhU/test/node1/data1/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-6-Filter.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-11-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-10-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data1/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-9-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-13-Summary.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/system-schema_usertypes-ka-1-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data2/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/system-sstable_activity-ka-1-Summary.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-11-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-5-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-11-Data.db,/tmp/dtest-wwgdhU/test/node1/data1/system/peers-37f71aca7dc2383ba70672528af04d4f/system-peers-ka-1-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-5-Summary.db,/tmp/dtest-wwgdhU/test/node1/data1/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-9-Data.db,/tmp/dtest-wwgdhU/test/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/system-compaction_history-ka-1-Data.db,/tmp/dtest-wwgdhU/test/node1/data1/system/peers-37f71aca7dc2383ba70672528af04d4f/system-peers-ka-1-Index.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-13-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-11-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data1/system/peers-37f71aca7dc2383ba70672528af04d4f/system-peers-ka-1-Summary.db,/tmp/dtest-wwgdhU/test/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/system-compaction_history-ka-1-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-11-Data.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-13-Data.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_keyspaces-b0f2235744583cdb9631c43e59ce3676/system-schema_keyspaces-ka-13-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-10-Index.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-9-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/system-compaction_history-ka-1-Index.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-11-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data1/system/peers-37f71aca7dc2383ba70672528af04d4f/system-peers-ka-1-Data.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-10-Summary.db,/tmp/dtest-wwgdhU/test/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/system-compaction_history-ka-1-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data1/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-9-Summary.db,/tmp/dtest-wwgdhU/test/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/system-compaction_history-ka-1-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-9-Summary.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-11-Summary.db,/tmp/dtest-wwgdhU/test/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/system-compaction_history-ka-1-Summary.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_triggers-0359bc7171233ee19a4ab9dfb11fc125/system-schema_triggers-ka-1-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-10-Index.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-11-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/system-schema_usertypes-ka-1-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data1/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-9-Index.db,/tmp/dtest-wwgdhU/test/node1/data1/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-6-Index.db,/tmp/dtest-wwgdhU/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-5-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-10-Summary.db,/tmp/dtest-wwgdhU/test/node1/data1/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-9-CompressionInfo.db,/tmp/dtest-wwgdhU/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-5-Data.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697/system-schema_columnfamilies-ka-11-Filter.db,/tmp/dtest-wwgdhU/test/node1/data0/system/schema_usertypes-3aa752254f82350b8d5c430fa221fa0a/system-schema_usertypes-ka-1-Index.db,/tmp/dtest-wwgdhU/test/node1/data2/system/local-7ad54392bcdd35a684174e047860b377/system-local-ka-5-Statistics.db,/tmp/dtest-wwgdhU/test/node1/data2/system/schema_columns-296e9c049bec3085827dc17d3df2122a/system-schema_columns-ka-11-Summary.db, please check NEWS.txt and ensure that you have upgraded through all required intermediate versions, running upgradesstables

Related failures:
http://cassci.datastax.com/job/trunk_dtest/1437/testReport/offline_tools_test/TestOfflineTools/sstableupgrade_test_2/
http://cassci.datastax.com/job/cassandra-3.X_dtest_upgrade/27/testReport/upgrade_tests.upgrade_supercolumns_test/TestSCUpgrade/upgrade_super_columns_through_all_versions_test_2/
http://cassci.datastax.com/job/cassandra-3.X_dtest_upgrade/27/testReport/upgrade_tests.upgrade_supercolumns_test/TestSCUpgrade/upgrade_super_columns_through_limited_versions_test_2/