Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3203

Rate-limit IO used by merging

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: IOContext branch
    • Component/s: core/store
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      Large merges can mess up searches and increase NRT reopen time (see
      http://blog.mikemccandless.com/2011/06/lucenes-near-real-time-search-is-fast.html).

      A simple rate limiter improves the spikey NRT reopen times during big
      merges, so I think we should somehow make this possible. Likely this
      would reduce impact on searches as well.

      Typically apps that do indexing and searching on same box are in no
      rush to see the merges complete so this is a good tradeoff.

        Attachments

        1. LUCENE-3203.patch
          7 kB
          Michael McCandless
        2. LUCENE-3203.patch
          10 kB
          Michael McCandless

        Issue Links

          Activity

            People

            • Assignee:
              mikemccand Michael McCandless
              Reporter:
              mikemccand Michael McCandless

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment