Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3203

Rate-limit IO used by merging

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: IOContext branch
    • Component/s: core/store
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Large merges can mess up searches and increase NRT reopen time (see
      http://blog.mikemccandless.com/2011/06/lucenes-near-real-time-search-is-fast.html).

      A simple rate limiter improves the spikey NRT reopen times during big
      merges, so I think we should somehow make this possible. Likely this
      would reduce impact on searches as well.

      Typically apps that do indexing and searching on same box are in no
      rush to see the merges complete so this is a good tradeoff.

        Attachments

        1. LUCENE-3203.patch
          7 kB
          Michael McCandless
        2. LUCENE-3203.patch
          10 kB
          Michael McCandless

          Issue Links

            Activity

              People

              • Assignee:
                mikemccand Michael McCandless
                Reporter:
                mikemccand Michael McCandless
              • Votes:
                0 Vote for this issue
                Watchers:
                0 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: