Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-6769

Various codec formats' testRandomExceptions() are failing with unexpected FileNotFoundException

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None
    • New

    Description

      From https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/934/ (I'll attach the full Jenkins consoleText, which has a bunch of exception output):

        [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLucene46SegmentInfoFormat -Dtests.method=testRandomExceptions -Dtests.seed=DE5D0B60FB3DAD54 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=de -Dtests.timezone=America/Sao_Paulo -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
         [junit4] FAILURE 0.53s J1 | TestLucene46SegmentInfoFormat.testRandomExceptions <<<
         [junit4]    > Throwable #1: java.lang.AssertionError: hit unexpected FileNotFoundException: file=_5k.si
         [junit4]    > 	at __randomizedtesting.SeedInfo.seed([DE5D0B60FB3DAD54:B67265A46533F4F4]:0)
         [junit4]    > 	at org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:753)
         [junit4]    > 	at org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:530)
         [junit4]    > 	at org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:456)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3680)
         [junit4]    > 	at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1929)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4731)
         [junit4]    > 	at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:695)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4757)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4748)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1476)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1254)
         [junit4]    > 	at org.apache.lucene.index.BaseIndexFileFormatTestCase.testRandomExceptions(BaseIndexFileFormatTestCase.java:429)
         [junit4]    > 	at org.apache.lucene.index.BaseSegmentInfoFormatTestCase.testRandomExceptions(BaseSegmentInfoFormatTestCase.java:48)
      
      [...]
      
         [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLucene46FieldInfoFormat -Dtests.method=testRandomExceptions -Dtests.seed=DE5D0B60FB3DAD54 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=sr_BA -Dtests.timezone=Asia/Tashkent -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
         [junit4] FAILURE 0.48s J0 | TestLucene46FieldInfoFormat.testRandomExceptions <<<
         [junit4]    > Throwable #1: java.lang.AssertionError: hit unexpected FileNotFoundException: file=_5k.si
         [junit4]    > 	at __randomizedtesting.SeedInfo.seed([DE5D0B60FB3DAD54:B67265A46533F4F4]:0)
         [junit4]    > 	at org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:753)
         [junit4]    > 	at org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:530)
         [junit4]    > 	at org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:456)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3680)
         [junit4]    > 	at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1929)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4731)
         [junit4]    > 	at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:695)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4757)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4748)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1476)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1254)
         [junit4]    > 	at org.apache.lucene.index.BaseIndexFileFormatTestCase.testRandomExceptions(BaseIndexFileFormatTestCase.java:429)
         [junit4]    > 	at org.apache.lucene.index.BaseFieldInfoFormatTestCase.testRandomExceptions(BaseFieldInfoFormatTestCase.java:50)
      

      From https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/939/ (again, I'll attach the consoleText):

         [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLucene46SegmentInfoFormat -Dtests.method=testRandomExceptions -Dtests.seed=1A10EDD0B2491A33 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=fr -Dtests.timezone=BET -Dtests.asserts=true -Dtests.file.encoding=UTF-8
         [junit4] FAILURE 0.20s J2 | TestLucene46SegmentInfoFormat.testRandomExceptions <<<
         [junit4]    > Throwable #1: java.lang.AssertionError: hit unexpected FileNotFoundException: file=_3g.si
         [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1A10EDD0B2491A33:723F83142C474393]:0)
         [junit4]    > 	at org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:753)
         [junit4]    > 	at org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:530)
         [junit4]    > 	at org.apache.lucene.index.IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:733)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:4700)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4218)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3664)
         [junit4]    > 	at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1929)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4731)
         [junit4]    > 	at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:695)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4757)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4748)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1476)
         [junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1254)
         [junit4]    > 	at org.apache.lucene.index.BaseIndexFileFormatTestCase.testRandomExceptions(BaseIndexFileFormatTestCase.java:429)
         [junit4]    > 	at org.apache.lucene.index.BaseSegmentInfoFormatTestCase.testRandomExceptions(BaseSegmentInfoFormatTestCase.java:48)
      

      From http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13710/ (which has since expired on Policeman Jenkins - below is from http://markmail.org/message/dw4hvvpreyr4jimi):

      Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13710/
      Java: 64bit/jdk1.7.0_80 -XX:+UseCompressedOops -XX:+UseG1GC
      
      1 tests failed.
      FAILED:
      org.apache.lucene.codecs.blocktree.TestLucene40BlockFormat.testRandomExceptions
      
      Error Message:
      hit unexpected FileNotFoundException: file=_9.si
      
      Stack Trace:
      java.lang.AssertionError: hit unexpected FileNotFoundException: file=_9.si
      	at __randomizedtesting.SeedInfo.seed([E3D1B260C7119B4B:8BFEDCA4591FC2EB]:0)
      	at
      org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:753)
      	at
      org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:530)
      	at org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:456)
      	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3680)
      	at
      org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
      	at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1929)
      	at
      org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4731)
      	at
      org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:695)
      	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4757)
      	at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4748)
      	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1476)
      	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1254)
      	at
      org.apache.lucene.index.BaseIndexFileFormatTestCase.testRandomExceptions(BaseIndexFileFormatTestCase.java:429)
      	at
      org.apache.lucene.index.BasePostingsFormatTestCase.testRandomExceptions(BasePostingsFormatTestCase.java:86)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at
      sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at
      com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
      	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
      	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
      	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
      	at
      org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
      	at
      org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
      	at
      org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
      	at
      org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
      	at
      org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
      	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      	at
      com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
      	at
      com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
      	at
      com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
      	at
      com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
      	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
      	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
      	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
      	at
      org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
      	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      	at
      org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
      	at
      com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
      	at
      com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
      	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      	at
      org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
      	at
      org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
      	at
      org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
      	at
      org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
      	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
      	at
      com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
      	at java.lang.Thread.run(Thread.java:745)
      
      Build Log:
      [...truncated 4475 lines...]
         [junit4] Suite: org.apache.lucene.codecs.blocktree.TestLucene40BlockFormat
         [junit4]   1> Unexpected exception: dumping fake-exception-log:...
         [junit4]   1> 
         [junit4]   1> TEST: got expected fake exc:a random IOException (_7.cfe)
         [junit4]   1> java.io.FileNotFoundException: a random IOException (_7.cfe)
         [junit4]   1> 	at
      org.apache.lucene.store.MockDirectoryWrapper.maybeThrowIOExceptionOnOpen(MockDirectoryWrapper.java:458)
         [junit4]   1> 	at
      org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:548)
         [junit4]   1> 	at
      org.apache.lucene.store.LockValidatingDirectoryWrapper.createOutput(LockValidatingDirectoryWrapper.java:44)
         [junit4]   1> 	at
      org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
         [junit4]   1> 	at
      org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43)
         [junit4]   1> 	at
      org.apache.lucene.codecs.lucene40.Lucene40CompoundWriter.close(Lucene40CompoundWriter.java:163)
         [junit4]   1> 	at
      org.apache.lucene.codecs.lucene40.Lucene40CompoundReader.close(Lucene40CompoundReader.java:160)
         [junit4]   1> 	at
      org.apache.lucene.codecs.lucene40.Lucene40CompoundFormat.write(Lucene40CompoundFormat.java:53)
         [junit4]   1> 	at
      org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:4680)
         [junit4]   1> 	at
      org.apache.lucene.index.DocumentsWriterPerThread.sealFlushedSegment(DocumentsWriterPerThread.java:492)
         [junit4]   1> 	at
      org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:459)
         [junit4]   1> 	at
      org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:503)
         [junit4]   1> 	at
      org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:615)
         [junit4]   1> 	at
      org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:423)
         [junit4]   1> 	at
      org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:86)
         [junit4]   1> 	at
      org.apache.lucene.index.BaseIndexFileFormatTestCase.testRandomExceptions(BaseIndexFileFormatTestCase.java:459)
         [junit4]   1> 	at
      org.apache.lucene.index.BasePostingsFormatTestCase.testRandomExceptions(BasePostingsFormatTestCase.java:86)
         [junit4]   1> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         [junit4]   1> 	at
      sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
         [junit4]   1> 	at
      sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
         [junit4]   1> 	at java.lang.reflect.Method.invoke(Method.java:606)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
         [junit4]   1> 	at
      org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
         [junit4]   1> 	at
      org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
         [junit4]   1> 	at
      org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
         [junit4]   1> 	at
      org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
         [junit4]   1> 	at
      org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
         [junit4]   1> 	at
      org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   1> 	at
      org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   1> 	at
      org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
         [junit4]   1> 	at
      org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
         [junit4]   1> 	at
      org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
         [junit4]   1> 	at
      org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   1> 	at
      com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
         [junit4]   1> 	at java.lang.Thread.run(Thread.java:745)
         [junit4]   1> 
         [junit4]   2> NOTE: reproduce with: ant test
      -Dtestcase=TestLucene40BlockFormat -Dtests.method=testRandomExceptions
      -Dtests.seed=E3D1B260C7119B4B -Dtests.multiplier=3 -Dtests.slow=true
      -Dtests.locale=en_IE -Dtests.timezone=America/Virgin -Dtests.asserts=true
      -Dtests.file.encoding=UTF-8
         [junit4] FAILURE 0.04s J0 | TestLucene40BlockFormat.testRandomExceptions <<<
         [junit4]    > Throwable #1: java.lang.AssertionError: hit unexpected
      FileNotFoundException: file=_9.si
         [junit4]    > 	at
      __randomizedtesting.SeedInfo.seed([E3D1B260C7119B4B:8BFEDCA4591FC2EB]:0)
         [junit4]    > 	at
      org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:753)
         [junit4]    > 	at
      org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:530)
         [junit4]    > 	at
      org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:456)
         [junit4]    > 	at
      org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3680)
         [junit4]    > 	at
      org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
         [junit4]    > 	at
      org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1929)
         [junit4]    > 	at
      org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4731)
         [junit4]    > 	at
      org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:695)
         [junit4]    > 	at
      org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4757)
         [junit4]    > 	at
      org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4748)
         [junit4]    > 	at
      org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1476)
         [junit4]    > 	at
      org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1254)
         [junit4]    > 	at
      org.apache.lucene.index.BaseIndexFileFormatTestCase.testRandomExceptions(BaseIndexFileFormatTestCase.java:429)
         [junit4]    > 	at
      org.apache.lucene.index.BasePostingsFormatTestCase.testRandomExceptions(BasePostingsFormatTestCase.java:86)
         [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
         [junit4]   2> NOTE: leaving temporary files on disk at:
      /home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build/backward-codecs/test/J0/temp/lucene.codecs.blocktree.TestLucene40BlockFormat_E3D1B260C7119B4B-001
         [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {},
      docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy):
      {body=DFR I(F)1, f_DOCS_AND_FREQS_AND_POSITIONS=IB LL-D3(800.0), field=DFR
      I(ne)B1, f_DOCS=DFR I(F)LZ(0.3), f_DOCS_AND_FREQS=DFR I(n)B2,
      f_DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS=DFR I(ne)L1, titleTokenized=IB
      LL-L2}, locale=en_IE, timezone=America/Virgin
         [junit4]   2> NOTE: Linux 3.19.0-26-generic amd64/Oracle Corporation 1.7.0_80
      (64-bit)/cpus=12,threads=1,free=196792272,total=525336576
         [junit4]   2> NOTE: All tests run in this JVM: [TestReuseDocsEnum,
      TestMaxPositionInOldIndex, TestLucene40TermVectorsFormat,
      TestLucene40SegmentInfoFormat, TestLucene42NormsFormat,
      TestBackwardsCompatibility, TestBitVector, TestLucene40PostingsFormat,
      TestLucene40BlockFormat]
         [junit4] Completed [19/30] on J0 in 3.12s, 31 tests, 1 failure <<< FAILURES!
      

      mikemccand previously looked at a couple of these: http://markmail.org/message/ogykur7itwihn36q and http://markmail.org/message/tmh2ul74esybvwvr.

      mikemccand noted when fixing one from July (from https://mail-archives.apache.org/mod_mbox/lucene-dev/201507.mbox/%3CCAL8PwkYXTs8cxgS1r_uBoFx6M7EvJezVsRg__64y7ZWO8PmzTA@mail.gmail.com%3E - oddly this email is not findable in markmail.org's archive):

      I just committed a fix. This was caused by a new assert from
      LUCENE-6616, basically making IndexWriter more picky such that a codec
      is not allowed to have created a file if in fact it didn't create it.

      In this case the SimpleTextSIFormat was claiming to have created a
      file (si.addFile) before createOutput succeeded, but then createOutput
      hit an exc (and the Directory impl took care of removing the file
      itself)...

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              sarowe Steven Rowe
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: