Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8598

Improve field updates packed values

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.7, 8.0
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      DocValuesFieldUpdats are using compact settings for packet ints that causes
      dramatic slowdowns when the updates are finished and sorted. Moving to the default
      accepted overhead ratio yields up to 4x improvements in applying updates. This change
      also improves the packing of numeric values since we know the value range in advance and
      can choose a different packing scheme in such a case.
      Overall this change yields a good performance improvement since 99% of the times of applying
      DV field updates are spend in the sort method which essentially makes applying the updates
      4x faster.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                simonw Simon Willnauer
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m