Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-13347

dtest failure in upgrade_tests.upgrade_through_versions_test.TestUpgrade_current_2_2_x_To_indev_3_0_x.rolling_upgrade_test

    XMLWordPrintableJSON

Details

    • Normal

    Description

      example failure:

      http://cassci.datastax.com/job/cassandra-3.0_large_dtest/58/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_2_2_x_To_indev_3_0_x/rolling_upgrade_test

      Error Message
      
      Subprocess ['nodetool', '-h', 'localhost', '-p', '7100', ['upgradesstables', '-a']] exited with non-zero status; exit status: 2; 
      stderr: error: null
      -- StackTrace --
      java.lang.AssertionError
      	at org.apache.cassandra.db.rows.Rows.collectStats(Rows.java:70)
      	at org.apache.cassandra.io.sstable.format.big.BigTableWriter$StatsCollector.applyToRow(BigTableWriter.java:197)
      	at org.apache.cassandra.db.transform.BaseRows.applyOne(BaseRows.java:116)
      	at org.apache.cassandra.db.transform.BaseRows.add(BaseRows.java:107)
      	at org.apache.cassandra.db.transform.UnfilteredRows.add(UnfilteredRows.java:41)
      	at org.apache.cassandra.db.transform.Transformation.add(Transformation.java:156)
      	at org.apache.cassandra.db.transform.Transformation.apply(Transformation.java:122)
      	at org.apache.cassandra.io.sstable.format.big.BigTableWriter.append(BigTableWriter.java:147)
      	at org.apache.cassandra.io.sstable.SSTableRewriter.append(SSTableRewriter.java:125)
      	at org.apache.cassandra.db.compaction.writers.DefaultCompactionWriter.realAppend(DefaultCompactionWriter.java:57)
      	at org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.append(CompactionAwareWriter.java:109)
      	at org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:195)
      	at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
      	at org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:89)
      	at org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:61)
      	at org.apache.cassandra.db.compaction.CompactionManager$5.execute(CompactionManager.java:415)
      	at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:307)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:79)
      	at java.lang.Thread.run(Thread.java:745)
      
      Stacktrace
      
        File "/usr/lib/python2.7/unittest/case.py", line 329, in run
          testMethod()
        File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 279, in rolling_upgrade_test
          self.upgrade_scenario(rolling=True)
        File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 345, in upgrade_scenario
          self.upgrade_to_version(version_meta, partial=True, nodes=(node,))
        File "/home/automaton/cassandra-dtest/upgrade_tests/upgrade_through_versions_test.py", line 446, in upgrade_to_version
          node.nodetool('upgradesstables -a')
        File "/home/automaton/venv/local/lib/python2.7/site-packages/ccmlib/node.py", line 789, in nodetool
          return handle_external_tool_process(p, ['nodetool', '-h', 'localhost', '-p', str(self.jmx_port), cmd.split()])
        File "/home/automaton/venv/local/lib/python2.7/site-packages/ccmlib/node.py", line 2002, in handle_external_tool_process
          raise ToolError(cmd_args, rc, out, err)
      

      Related failures:

      http://cassci.datastax.com/job/cassandra-3.0_large_dtest/58/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_2_1_x_To_indev_3_0_x/rolling_upgrade_with_internode_ssl_test/

      http://cassci.datastax.com/job/cassandra-3.0_large_dtest/58/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_2_2_x_To_indev_3_0_x/rolling_upgrade_with_internode_ssl_test/

      http://cassci.datastax.com/job/cassandra-3.0_large_dtest/58/testReport/upgrade_tests.upgrade_through_versions_test/TestUpgrade_current_2_1_x_To_indev_3_0_x/rolling_upgrade_test/

      Attachments

        1. node1_debug.log
          4.91 MB
          Sean McCarthy
        2. node1_gc.log
          18 kB
          Sean McCarthy
        3. node1.log
          98 kB
          Sean McCarthy
        4. node2_debug.log
          4.10 MB
          Sean McCarthy
        5. node2_gc.log
          67 kB
          Sean McCarthy
        6. node2.log
          65 kB
          Sean McCarthy
        7. node3_debug.log
          8.04 MB
          Sean McCarthy
        8. node3_gc.log
          72 kB
          Sean McCarthy
        9. node3.log
          66 kB
          Sean McCarthy

        Issue Links

          Activity

            People

              Unassigned Unassigned
              sean.mccarthy Sean McCarthy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: