Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8598

Improve field updates packed values

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 7.7, 8.0
    • None
    • None
    • New

    Description

      DocValuesFieldUpdats are using compact settings for packet ints that causes
      dramatic slowdowns when the updates are finished and sorted. Moving to the default
      accepted overhead ratio yields up to 4x improvements in applying updates. This change
      also improves the packing of numeric values since we know the value range in advance and
      can choose a different packing scheme in such a case.
      Overall this change yields a good performance improvement since 99% of the times of applying
      DV field updates are spend in the sort method which essentially makes applying the updates
      4x faster.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              simonw Simon Willnauer
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m