[LUCENE-7011] TestSimpleTextPointFormat.testWithExceptions() failure

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 6.0
• Lucene Fields: New
• Assignee: Michael McCandless
• Reporter: Steven Rowe
• Created: 03/Feb/16 13:22
• Updated: 28/Aug/22 14:49
• Resolved: 03/Feb/16 15:19

Description

My Jenkins found a reproducible seed:

   [junit4] Suite: org.apache.lucene.codecs.simpletext.TestSimpleTextPointFormat
   [junit4] IGNOR/A 0.01s J5 | TestSimpleTextPointFormat.testMergeStability
   [junit4]    > Assumption #1: merge is not stable
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSimpleTextPointFormat -Dtests.method=testWithExceptions -Dtests.seed=73B4A097F1853FC0 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ar-YE -Dtests.timezone=America/Curacao -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.24s J5 | TestSimpleTextPointFormat.testWithExceptions <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still open files: {_0_bkd_0.tmp=1}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([73B4A097F1853FC0:D1E73CEB7E0B703A]:0)
   [junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:771)
   [junit4]    > 	at org.apache.lucene.index.BasePointFormatTestCase.testWithExceptions(BasePointFormatTestCase.java:253)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.lang.RuntimeException: unclosed IndexOutput: _0_bkd_0.tmp
   [junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:659)
   [junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.createTempOutput(MockDirectoryWrapper.java:631)
   [junit4]    > 	at org.apache.lucene.store.FilterDirectory.createTempOutput(FilterDirectory.java:78)
   [junit4]    > 	at org.apache.lucene.store.TrackingDirectoryWrapper.createTempOutput(TrackingDirectoryWrapper.java:51)
   [junit4]    > 	at org.apache.lucene.store.TrackingDirectoryWrapper.createTempOutput(TrackingDirectoryWrapper.java:51)
   [junit4]    > 	at org.apache.lucene.util.bkd.OfflinePointWriter.<init>(OfflinePointWriter.java:39)
   [junit4]    > 	at org.apache.lucene.util.bkd.BKDWriter.switchToOffline(BKDWriter.java:198)
   [junit4]    > 	at org.apache.lucene.util.bkd.BKDWriter.add(BKDWriter.java:217)
   [junit4]    > 	at org.apache.lucene.codecs.simpletext.SimpleTextPointWriter$2.visit(SimpleTextPointWriter.java:164)
   [junit4]    > 	at org.apache.lucene.index.PointValuesWriter$1.intersect(PointValuesWriter.java:75)
   [junit4]    > 	at org.apache.lucene.codecs.simpletext.SimpleTextPointWriter.writeField(SimpleTextPointWriter.java:157)
   [junit4]    > 	at org.apache.lucene.index.PointValuesWriter.flush(PointValuesWriter.java:66)
   [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.writePoints(DefaultIndexingChain.java:172)
   [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:107)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:425)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:502)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:614)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3099)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3074)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1727)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1707)
   [junit4]    > 	at org.apache.lucene.index.RandomIndexWriter.forceMerge(RandomIndexWriter.java:422)
   [junit4]    > 	at org.apache.lucene.index.BasePointFormatTestCase.verify(BasePointFormatTestCase.java:663)
   [junit4]    > 	at org.apache.lucene.index.BasePointFormatTestCase.testWithExceptions(BasePointFormatTestCase.java:222)
   [junit4]    > 	... 36 more
   [junit4] IGNOR/A 0.00s J5 | TestSimpleTextPointFormat.testRandomBinaryBig
   [junit4]    > Assumption #1: too slow with SimpleText
   [junit4]   2> NOTE: leaving temporary files on disk at: /var/lib/jenkins/jobs/Lucene-Solr-Nightly-5.x-Java8/workspace/lucene/build/codecs/test/J5/temp/lucene.codecs.simpletext.TestSimpleTextPointFormat_73B4A097F1853FC0-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=ar-YE, timezone=America/Curacao
   [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=16,threads=1,free=415913304,total=536346624
   [junit4]   2> NOTE: All tests run in this JVM: [TestSimpleTextPostingsFormat, TestFixedGapPostingsFormat, TestSimpleTextPointFormat]
   [junit4] Completed [17/22 (1!)] on J5 in 47.49s, 16 tests, 1 error, 2 skipped <<< FAILURES!