[ASTERIXDB-1841] Dropping a large inverted index generates an exception

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Murtadha Makki Al Hubail
• Reporter: Taewoo Kim
• Created: 15/Mar/17 00:22
• Updated: 24/Mar/17 16:27
• Resolved: 23/Mar/17 18:56

Description

There are four NCs and each NC has 6GB of allocated memory.
The size of the dataset itself is about 60GB. The index size is about 37GB.
When I just tried to delete this index by using the following AQL, an exception occurred.

use dataverse exp;

drop index AmazonReviewNoDup. AmazonReviewNoDup_reviewText_kw_idx;

org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor [ClassCastException]

Detailed Exception from the log:

org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228)
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84)
	at org.apache.hyracks.control.nc.Task.run(Task.java:273)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222)
	... 5 more
Caused by: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
	at org.apache.hyracks.storage.am.lsm.invertedindex.dataflow.PartitionedLSMInvertedIndexDataflowHelper.createIndexInstance(PartitionedLSMInvertedIndexDataflowHelper.java:79)
	at org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:140)
	at org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	... 3 more
org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228)
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84)
	at org.apache.hyracks.control.nc.Task.run(Task.java:273)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222)
	... 5 more
Caused by: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
	at org.apache.hyracks.storage.am.lsm.invertedindex.dataflow.PartitionedLSMInvertedIndexDataflowHelper.createIndexInstance(PartitionedLSMInvertedIndexDataflowHelper.java:79)
	at org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:140)
	at org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	... 3 more