[ASTERIXDB-2127] Invalid virtual file state for in-memory component

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: HYR - Hyracks, STO - Storage
• Assignee: Unassigned
• Reporter: Ian Maxon
• Created: 05/Oct/17 23:08
• Updated: 05/Oct/17 23:08

Description

Using a file-feed to ingest, it seems that the in-memory component can be coaxed into an invalid state with regards to file mapping. Below stack is constantly repeated on each NC:

Oct 05, 2017 3:50:12 PM org.apache.asterix.external.feed.dataflow.FeedExceptionHandler logExceptionCausingTuple
WARNING: HYR0002: Error in processing tuple 0 in a frame
org.apache.hyracks.api.exceptions.HyracksDataException: HYR0002: Error in processing tuple 0 in a frame
at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:55)
at org.apache.asterix.common.dataflow.LSMInsertDeleteOperatorNodePushable.nextFrame(LSMInsertDeleteOperatorNodePushable.java:147)
at org.apache.asterix.external.feed.dataflow.SyncFeedRuntimeInputHandler.nextFrame(SyncFeedRuntimeInputHandler.java:46)
at org.apache.asterix.external.operators.FeedMetaStoreNodePushable.nextFrame(FeedMetaStoreNodePushable.java:141)
at org.apache.hyracks.control.nc.Task.pushFrames(Task.java:393)
at org.apache.hyracks.control.nc.Task.run(Task.java:318)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: HYR0081: File /mnt/msata/asterix-server-0.9.3-SNAPSHOT-binary-assembly/opt/local/data/blue0/storage/partition_0/twitter/aca_int_idx_aca_int_virtual_0 is already mapped
at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:51)
at org.apache.hyracks.storage.common.file.FileMapManager.registerFile(FileMapManager.java:76)
at org.apache.hyracks.storage.am.lsm.common.impls.VirtualBufferCache.createFile(VirtualBufferCache.java:79)
at org.apache.hyracks.storage.am.lsm.common.impls.MultitenantVirtualBufferCache.createFile(MultitenantVirtualBufferCache.java:49)
at org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex.create(AbstractTreeIndex.java:83)
at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.allocateMemoryComponent(LSMBTree.java:611)
at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.allocateMemoryComponents(AbstractLSMIndex.java:386)
at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.modify(LSMHarness.java:421)
at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.modify(LSMHarness.java:375)
at org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.insert(LSMTreeIndexAccessor.java:66)
at org.apache.asterix.common.dataflow.LSMInsertDeleteOperatorNodePushable.nextFrame(LSMInsertDeleteOperatorNodePushable.java:125)