Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-3203

Rate-limit IO used by merging

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • IOContext branch
    • core/store
    • None
    • New

    Description

      Large merges can mess up searches and increase NRT reopen time (see
      http://blog.mikemccandless.com/2011/06/lucenes-near-real-time-search-is-fast.html).

      A simple rate limiter improves the spikey NRT reopen times during big
      merges, so I think we should somehow make this possible. Likely this
      would reduce impact on searches as well.

      Typically apps that do indexing and searching on same box are in no
      rush to see the merges complete so this is a good tradeoff.

      Attachments

        1. LUCENE-3203.patch
          7 kB
          Michael McCandless
        2. LUCENE-3203.patch
          10 kB
          Michael McCandless

        Issue Links

          Activity

            People

              mikemccand Michael McCandless
              mikemccand Michael McCandless
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: