[ASTERIXDB-1974] Sporadic failure in rebalance cancelation

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: CLUS - Cluster management
• Assignee: Murtadha Makki Al Hubail
• Reporter: Murtadha Makki Al Hubail
• Created: 05/Jul/17 10:33
• Updated: 07/Nov/17 20:28
• Resolved: 07/Nov/17 20:28

Description

The build was aborted after 80 mins. The following stack trace was found in the build output.

02:04:31 Expected results file: src/test/resources/runtimets/results/rebalance/single_dataset_with_index/single_dataset_with_index.8.adm
02:04:32 java.lang.InterruptedException
02:04:32 	at java.lang.Object.wait(Native Method)
02:04:32 	at java.lang.Object.wait(Object.java:502)
02:04:32 	at org.apache.hyracks.storage.common.buffercache.AsyncFIFOPageQueueManager.finishQueue(AsyncFIFOPageQueueManager.java:132)
02:04:32 	at org.apache.hyracks.storage.common.buffercache.BufferCache.finishQueue(BufferCache.java:1386)
02:04:32 	at org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex$AbstractTreeIndexBulkLoader.end(AbstractTreeIndex.java:282)
02:04:32 	at org.apache.hyracks.storage.am.btree.impls.BTree$BTreeBulkLoader.end(BTree.java:1182)
02:04:32 	at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMDiskComponentBulkLoader.end(AbstractLSMDiskComponentBulkLoader.java:157)
02:04:32 	at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeBulkLoader.end(LSMBTreeBulkLoader.java:47)
02:04:32 	at org.apache.hyracks.storage.am.common.dataflow.IndexBulkLoadOperatorNodePushable.close(IndexBulkLoadOperatorNodePushable.java:92)
02:04:32 	at org.apache.hyracks.dataflow.std.sort.AbstractExternalSortRunMerger.process(AbstractExternalSortRunMerger.java:175)
02:04:32 	at org.apache.hyracks.dataflow.std.sort.AbstractSorterOperatorDescriptor$MergeActivity$1.initialize(AbstractSorterOperatorDescriptor.java:181)
02:04:32 	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$0(SuperActivityOperatorNodePushable.java:202)
02:04:32 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
02:04:32 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
02:04:32 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
02:04:32 	at java.lang.Thread.run(Thread.java:745)
02:04:32 java.lang.InterruptedException
02:04:32 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1220)
02:04:32 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:335)
02:04:32 	at java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:339)
02:04:32 	at org.apache.hyracks.storage.common.buffercache.AsyncFIFOPageQueueManager$PageQueue.put(AsyncFIFOPageQueueManager.java:63)
02:04:32 	at org.apache.hyracks.storage.am.common.freepage.AppendOnlyLinkedMetadataPageManager.close(AppendOnlyLinkedMetadataPageManager.java:223)
02:04:32 	at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.markAsValidInternal(AbstractLSMIndex.java:394)
02:04:32 	at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.markAsValid(LSMBTree.java:465)
02:04:32 	at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.addBulkLoadedComponent(LSMHarness.java:566)
02:04:32 	at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeBulkLoader.end(LSMBTreeBulkLoader.java:53)
02:04:32 	at org.apache.hyracks.storage.am.common.dataflow.IndexBulkLoadOperatorNodePushable.close(IndexBulkLoadOperatorNodePushable.java:92)
02:04:32 	at org.apache.hyracks.dataflow.std.sort.AbstractExternalSortRunMerger.process(AbstractExternalSortRunMerger.java:175)
02:04:32 	at org.apache.hyracks.dataflow.std.sort.AbstractSorterOperatorDescriptor$MergeActivity$1.initialize(AbstractSorterOperatorDescriptor.java:181)
02:04:32 	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$0(SuperActivityOperatorNodePushable.java:202)
02:04:32 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
02:04:32 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
02:04:32 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
02:04:32 	at java.lang.Thread.run(Thread.java:745)