Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8293

Ensure only hard deletes are carried over in a merge

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 7.4, 8.0
    • 7.4, 8.0
    • None
    • None
    • New

    Description

      Today we carry over hard deletes based on the SegmentReaders liveDocs.
      This is not correct if soft-deletes are used especially with rentention
      policies. If a soft delete is added while a segment is merged the document
      might end up hard deleted in the target segment. This isn't necessarily a
      correctness issue but causes unnecessary writes of hard-deletes. The biggest
      issue here is that we assert that previously deleted documents are still deleted
      in the live-docs we apply and that might be violated by the retention policy.

      Attachments

        1. LUCENE-8293.patch
          19 kB
          Simon Willnauer
        2. LUCENE-8293.patch
          14 kB
          Simon Willnauer

        Activity

          People

            Unassigned Unassigned
            simonw Simon Willnauer
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: