Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-6049

Cryptic exception if all docs in a segment hit non-aborting exceptions before adding their doc values

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.10.3, 5.0, 6.0
    • Component/s: core/index
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      I hit this while working on LUCENE-6005:

      If you add a document with a single field that's both indexed and has doc values, and during inversion it hits a non-aborting exception, and all docs for a given segment had this happen, then you'll hit this confusing exception:

      java.lang.AssertionError: segment=_0(6.0.0):C2: field="test" has docValues but did not write them
      	at __randomizedtesting.SeedInfo.seed([21BFA52E65A19C81:3A824781C0F77629]:0)
      	at org.apache.lucene.index.DefaultIndexingChain.writeDocValues(DefaultIndexingChain.java:146)
      	at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:93)
      	at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:440)
      	at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:511)
      	at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:622)
      	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3016)
      	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2992)
      	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:946)
      	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:991)
      	at org.apache.lucene.index.TestDocValuesIndexing.testExcIndexingDocBeforeDocValues(TestDocValuesIndexing.java:927)
      

      The good news here is that exception is new from LUCENE-6019 and it prevents this case from causing index corruption, but the bad news is, you shouldn't even get an exception writing the segment in the first place.

        Attachments

        1. LUCENE-6049.patch
          4 kB
          Michael McCandless
        2. LUCENE-6049.patch
          31 kB
          Michael McCandless

          Activity

            People

            • Assignee:
              mikemccand Michael McCandless
              Reporter:
              mikemccand Michael McCandless
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: