[LUCENE-6049] Cryptic exception if all docs in a segment hit non-aborting exceptions before adding their doc values

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.10.3, 5.0, 6.0
• Component/s: core/index
• Lucene Fields: New
• Assignee: Michael McCandless
• Reporter: Michael McCandless
• Created: 05/Nov/14 09:56
• Updated: 28/Aug/22 14:19
• Resolved: 08/Nov/14 09:17

Description

I hit this while working on LUCENE-6005:

If you add a document with a single field that's both indexed and has doc values, and during inversion it hits a non-aborting exception, and all docs for a given segment had this happen, then you'll hit this confusing exception:

java.lang.AssertionError: segment=_0(6.0.0):C2: field="test" has docValues but did not write them
	at __randomizedtesting.SeedInfo.seed([21BFA52E65A19C81:3A824781C0F77629]:0)
	at org.apache.lucene.index.DefaultIndexingChain.writeDocValues(DefaultIndexingChain.java:146)
	at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:93)
	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:440)
	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:511)
	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:622)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3016)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2992)
	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:946)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:991)
	at org.apache.lucene.index.TestDocValuesIndexing.testExcIndexingDocBeforeDocValues(TestDocValuesIndexing.java:927)

The good news here is that exception is new from LUCENE-6019 and it prevents this case from causing index corruption, but the bad news is, you shouldn't even get an exception writing the segment in the first place.