Uploaded image for project: 'Apache AsterixDB'
  1. Apache AsterixDB
  2. ASTERIXDB-1841

Dropping a large inverted index generates an exception

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      There are four NCs and each NC has 6GB of allocated memory.
      The size of the dataset itself is about 60GB. The index size is about 37GB.
      When I just tried to delete this index by using the following AQL, an exception occurred.

      use dataverse exp;
      
      drop index AmazonReviewNoDup. AmazonReviewNoDup_reviewText_kw_idx;
      
      org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor [ClassCastException]
      

      Detailed Exception from the log:

      org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228)
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84)
      	at org.apache.hyracks.control.nc.Task.run(Task.java:273)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: java.util.concurrent.ExecutionException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222)
      	... 5 more
      Caused by: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
      	at org.apache.hyracks.storage.am.lsm.invertedindex.dataflow.PartitionedLSMInvertedIndexDataflowHelper.createIndexInstance(PartitionedLSMInvertedIndexDataflowHelper.java:79)
      	at org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:140)
      	at org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	... 3 more
      org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228)
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84)
      	at org.apache.hyracks.control.nc.Task.run(Task.java:273)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: java.util.concurrent.ExecutionException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
      	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222)
      	... 5 more
      Caused by: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
      	at org.apache.hyracks.storage.am.lsm.invertedindex.dataflow.PartitionedLSMInvertedIndexDataflowHelper.createIndexInstance(PartitionedLSMInvertedIndexDataflowHelper.java:79)
      	at org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:140)
      	at org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
      	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	... 3 more
      

        Attachments

          Activity

            People

            • Assignee:
              mhubail Murtadha Makki Al Hubail
              Reporter:
              wangsaeu Taewoo Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: