Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8293

Ensure only hard deletes are carried over in a merge

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 7.4, 8.0
    • Fix Version/s: 7.4, 8.0
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Today we carry over hard deletes based on the SegmentReaders liveDocs.
      This is not correct if soft-deletes are used especially with rentention
      policies. If a soft delete is added while a segment is merged the document
      might end up hard deleted in the target segment. This isn't necessarily a
      correctness issue but causes unnecessary writes of hard-deletes. The biggest
      issue here is that we assert that previously deleted documents are still deleted
      in the live-docs we apply and that might be violated by the retention policy.

        Attachments

        1. LUCENE-8293.patch
          19 kB
          Simon Willnauer
        2. LUCENE-8293.patch
          14 kB
          Simon Willnauer

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              simonw Simon Willnauer
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: