Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-8564

Harmless exception logged as ERROR

    XMLWordPrintableJSON

Details

    • Low

    Description

      After CASSANDRA-8474, when running the dtest counter_test.py:TestCounters.upgrade_test, we now see the following in the log:

      ERROR [CompactionExecutor:2] 2015-01-05 13:59:51,003 CassandraDaemon.java:170 - Exception in thread Thread[CompactionExecutor:2,1,main]
      java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@5e8ea989 rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
              at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048) ~[na:1.7.0_67]
              at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) ~[na:1.7.0_67]
              at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:325) ~[na:1.7.0_67]
              at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:530) ~[na:1.7.0_67]
              at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:619) ~[na:1.7.0_67]
              at org.apache.cassandra.io.sstable.SSTableReader.scheduleTidy(SSTableReader.java:638) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableReader.tidy(SSTableReader.java:619) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableReader.releaseReference(SSTableReader.java:1650) ~[main/:na]
              at org.apache.cassandra.db.DataTracker.replaceReaders(DataTracker.java:409) ~[main/:na]
              at org.apache.cassandra.db.DataTracker.replaceWithNewInstances(DataTracker.java:303) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableRewriter.moveStarts(SSTableRewriter.java:254) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableRewriter.abort(SSTableRewriter.java:180) ~[main/:na]
              at org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:205) ~[main/:na]
              at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[main/:na]
              at org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:75) ~[main/:na]
              at org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59) ~[main/:na]
              at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:226) ~[main/:na]
              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_67]
              at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_67]
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_67]
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_67]
              at java.lang.Thread.run(Thread.java:745) [na:1.7.0_67]
              Suppressed: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@681c91de rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
                      at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048) ~[na:1.7.0_67]
                      at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) ~[na:1.7.0_67]
                      at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:325) ~[na:1.7.0_67]
                      at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:530) ~[na:1.7.0_67]
                      at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:619) ~[na:1.7.0_67]
                      at org.apache.cassandra.io.sstable.SSTableReader.scheduleTidy(SSTableReader.java:638) ~[main/:na]
                      at org.apache.cassandra.io.sstable.SSTableReader.tidy(SSTableReader.java:619) ~[main/:na]
                      at org.apache.cassandra.io.sstable.SSTableReader.releaseReference(SSTableReader.java:1650) ~[main/:na]
                      at org.apache.cassandra.io.sstable.SSTableScanner.close(SSTableScanner.java:176) ~[main/:na]
                      at org.apache.cassandra.db.compaction.AbstractCompactionStrategy$ScannerList.close(AbstractCompactionStrategy.java:330) ~[main/:na]
                      at org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:255) ~[main/:na]
                      ... 9 common frames omitted
                      Suppressed: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@232f05a4 rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
                              ... 20 common frames omitted
                      Suppressed: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@641b6407 rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
                              ... 20 common frames omitted
                      Suppressed: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@42443ae9 rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
                              ... 20 common frames omitted
      ERROR [CompactionExecutor:1] 2015-01-05 13:59:51,010 CassandraDaemon.java:170 - Exception in thread Thread[CompactionExecutor:1,1,main]
      java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@46f365c7 rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
              at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048) ~[na:1.7.0_67]
              at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) ~[na:1.7.0_67]
              at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:325) ~[na:1.7.0_67]
              at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:530) ~[na:1.7.0_67]
              at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:619) ~[na:1.7.0_67]
              at org.apache.cassandra.io.sstable.SSTableReader.scheduleTidy(SSTableReader.java:638) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableReader.tidy(SSTableReader.java:619) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableReader.releaseReference(SSTableReader.java:1650) ~[main/:na]
              at org.apache.cassandra.db.DataTracker.replaceReaders(DataTracker.java:409) ~[main/:na]
              at org.apache.cassandra.db.DataTracker.replaceWithNewInstances(DataTracker.java:303) ~[main/:na]
                              ... 20 common frames omitted
      ERROR [CompactionExecutor:1] 2015-01-05 13:59:51,010 CassandraDaemon.java:170 - Exception in thread Thread
      [CompactionExecutor:1,1,main]
      java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$Sch
      eduledFutureTask@46f365c7 rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecu
      tor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
              at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2
      048) ~[na:1.7.0_67]
              at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) ~[na:1.7.0_67]
              at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.jav
      a:325) ~[na:1.7.0_67]
              at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:530)
       ~[na:1.7.0_67]
              at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:619)
      ~[na:1.7.0_67]
              at org.apache.cassandra.io.sstable.SSTableReader.scheduleTidy(SSTableReader.java:638) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableReader.tidy(SSTableReader.java:619) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableReader.releaseReference(SSTableReader.java:1650) ~[main/
      :na]
              at org.apache.cassandra.db.DataTracker.replaceReaders(DataTracker.java:409) ~[main/:na]
              at org.apache.cassandra.db.DataTracker.replaceWithNewInstances(DataTracker.java:303) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableRewriter.moveStarts(SSTableRewriter.java:254) ~[main/:na]
              at org.apache.cassandra.io.sstable.SSTableRewriter.abort(SSTableRewriter.java:180) ~[main/:na]
              at org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:205) ~[main/:na]
              at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[main/:na]
              at org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:75) ~[main/:na]
              at org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59) ~[main/:na]
              at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:226) ~[main/:na]
              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) ~[na:1.7.0_67]
              at java.util.concurrent.FutureTask.run(FutureTask.java:262) ~[na:1.7.0_67]
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_67]
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_67]
              at java.lang.Thread.run(Thread.java:745) [na:1.7.0_67]
              Suppressed: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@159f1035 rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
                      at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048) ~[na:1.7.0_67]
                      at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821) ~[na:1.7.0_67]
                      at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:325) ~[na:1.7.0_67]
                      at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:530) ~[na:1.7.0_67]
                      at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:619) ~[na:1.7.0_67]
                      at org.apache.cassandra.io.sstable.SSTableReader.scheduleTidy(SSTableReader.java:638) ~[main/:na]
                      at org.apache.cassandra.io.sstable.SSTableReader.tidy(SSTableReader.java:619) ~[main/:na]
                      at org.apache.cassandra.io.sstable.SSTableReader.releaseReference(SSTableReader.java:1650) ~[main/:na]
                      at org.apache.cassandra.io.sstable.SSTableScanner.close(SSTableScanner.java:176) ~[main/:na]
                      at org.apache.cassandra.db.compaction.AbstractCompactionStrategy$ScannerList.close(AbstractCompactionStrategy.java:330) ~[main/:na]
                      at org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:255) ~[main/:na]
                      ... 9 common frames omitted
                      Suppressed: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@7de112a9 rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
                              ... 20 common frames omitted
                      Suppressed: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@439055cf rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
                              ... 20 common frames omitted
                      Suppressed: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@38f1abb0 rejected from org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor@7fc92f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 5]
                              ... 20 common frames omitted
      

      According to Benedict, this is harmless. Thus, it should be logged at WARN.

      Attachments

        Issue Links

          Activity

            People

              tjake T Jake Luciani
              philipthompson Philip Thompson
              T Jake Luciani
              Tom Hobbs
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: