[LUCENE-3203] Rate-limit IO used by merging

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: IOContext branch
• Component/s: core/store
• Lucene Fields: New
• Assignee: Michael McCandless
• Reporter: Michael McCandless
• Created: 14/Jun/11 17:22
• Updated: 28/Aug/22 12:50
• Resolved: 26/Jun/11 18:50

Description

Large merges can mess up searches and increase NRT reopen time (see
http://blog.mikemccandless.com/2011/06/lucenes-near-real-time-search-is-fast.html).

A simple rate limiter improves the spikey NRT reopen times during big
merges, so I think we should somehow make this possible. Likely this
would reduce impact on searches as well.

Typically apps that do indexing and searching on same box are in no
rush to see the merges complete so this is a good tradeoff.

Issue Links

• is blocked by: LUCENE-2793 Directory createOutput and openInput should take an IOContext