Lucene - Core
  1. Lucene - Core
  2. LUCENE-3210

TieredMergePolicy should expose control over how aggressively segments with deletions are targeted

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3, 4.0-ALPHA
    • Component/s: core/index
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      TMP today always does a linear pro-rating of a merge's score according to what pctg of the documents are deleted; I'd like to 1) put a power factor in (score is multiplicative), and 2) default it to stronger favoring of merging away deletions.

      1. LUCENE-3210.patch
        2 kB
        Michael McCandless

        Activity

        Hide
        Yonik Seeley added a comment -

        Good idea... +1 for a power factor above 1.

        Show
        Yonik Seeley added a comment - Good idea... +1 for a power factor above 1.
        Hide
        Michael McCandless added a comment -

        Simple patch, adding setReclaimDeletesWeight to TMP, and defaulting it to 2.0. I also fixed LTC.newTieredMergePolicy to randomly set this...

        Show
        Michael McCandless added a comment - Simple patch, adding setReclaimDeletesWeight to TMP, and defaulting it to 2.0. I also fixed LTC.newTieredMergePolicy to randomly set this...
        Hide
        Uwe Schindler added a comment -

        Great idea, I was thinking about that when I wrote the reply about no need to optimize in java-user!

        Show
        Uwe Schindler added a comment - Great idea, I was thinking about that when I wrote the reply about no need to optimize in java-user!
        Hide
        Robert Muir added a comment -

        bulk close for 3.3

        Show
        Robert Muir added a comment - bulk close for 3.3

          People

          • Assignee:
            Michael McCandless
            Reporter:
            Michael McCandless
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development