Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-9935

Bulk merges for stored fields when index sorting is enabled

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 9.0, 8.10
    • None
    • None
    • New

    Description

      Today stored fields disable bulk merges entirely when index sorting is enabled. However when sorting by low-cardinality fields or when the index sort is correlated with the order in which documents get indexed, we could likely still have efficient bulk merges.

      For instance, if you are merging two segments that are sorted on a field that can only take 2 values, one could bulk merge the first half of the first segment, then the first half of the second segment, then the second half of the first segment, and finally the second half of the second segment.

      Attachments

        Activity

          People

            dnhatn Nhat Nguyen
            jpountz Adrien Grand
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 5h 20m
                5h 20m