[ASTERIXDB-1990] File-not-found in deleting file

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Component/s: STO - Storage
• Assignee: Murtadha Makki Al Hubail
• Reporter: Yingyi Bu
• Created: 20/Jul/17 00:59
• Updated: 14/Aug/17 09:34
• Resolved: 14/Aug/17 09:34

Description

https://asterix-jenkins.ics.uci.edu/job/asterix-gerrit-asterix-app/org.apache.asterix$asterix-app/1273/testReport/junit/org.apache.asterix.test.runtime/AqlExecutionTest/test_AqlExecutionTest_339__dml__using_no_merge_policy_/

Expected results file: src/test/resources/runtimets/results/dml/using-no-merge-policy/using-no-merge-policy.1.adm
org.apache.hyracks.api.exceptions.HyracksDataException: HYR0019: Cannot delete the file: /home/jenkins/workspace/asterix-gerrit-asterix-app/asterixdb/asterix-app/target/io/dir/asterix_nc1/iodevice0/storage/partition_0/test/LineItem_idx_LineItem/2017-07-20-00-31-09-349_2017-07-20-00-31-09-349_b
	at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:53)
	at org.apache.hyracks.api.util.IoUtil.delete(IoUtil.java:67)
	at org.apache.hyracks.api.util.IoUtil.delete(IoUtil.java:48)
	at org.apache.hyracks.storage.common.buffercache.BufferCache.deleteFile(BufferCache.java:1008)
	at org.apache.hyracks.storage.common.buffercache.BufferCache.deleteFile(BufferCache.java:970)
	at org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex.destroy(AbstractTreeIndex.java:138)
	at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeDiskComponent.destroy(LSMBTreeDiskComponent.java:41)
	at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.exitComponents(LSMHarness.java:344)
	at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.merge(LSMHarness.java:556)
	at org.apache.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.merge(LSMTreeIndexAccessor.java:127)
	at org.apache.hyracks.storage.am.lsm.common.impls.MergeOperation.call(MergeOperation.java:48)
	at org.apache.hyracks.storage.am.lsm.common.impls.MergeOperation.call(MergeOperation.java:30)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.nio.file.NoSuchFileException: target/io/dir/asterix_nc1/iodevice0/storage/partition_0/test/LineItem_idx_LineItem/2017-07-20-00-31-09-349_2017-07-20-00-31-09-349_b
	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
	at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244)
	at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
	at java.nio.file.Files.delete(Files.java:1126)
	at org.apache.hyracks.api.util.IoUtil.delete(IoUtil.java:64)
	... 14 more
org.apache.asterix.common.exceptions.AsterixException: FileNotFoundException: File does not exist: target/io/dir/asterix_nc1/iodevice0/storage/partition_0/test/LineItem_idx_LineItem/2017-07-20-00-31-09-435_2017-07-20-00-31-09-435_f
	at org.apache.asterix.test.common.ResultExtractor.extract(ResultExtractor.java:80)
	at org.apache.asterix.test.common.TestExecutor.cleanup(TestExecutor.java:1421)
	at org.apache.asterix.test.runtime.LangExecutionUtil.test(LangExecutionUtil.java:130)
	at org.apache.asterix.test.runtime.LangExecutionUtil.test(LangExecutionUtil.java:112)
	at org.apache.asterix.test.runtime.AqlExecutionTest.test(AqlExecutionTest.java:63)
	at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143)

Issue Links

• is broken by: ASTERIXDB-2025 MergeOperation completes before deleting old components from disk