[LUCENE-3092] NRTCachingDirectory, to buffer small segments in a RAMDir

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.2, 4.0-ALPHA
• Component/s: core/store
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Michael McCandless
• Created: 12/May/11 22:14
• Updated: 28/Aug/22 12:46
• Resolved: 17/May/11 18:02

Description

I created this simply Directory impl, whose goal is reduce IO
contention in a frequent reopen NRT use case.

The idea is, when reopening quickly, but not indexing that much
content, you wind up with many small files created with time, that can
possibly stress the IO system eg if merges, searching are also
fighting for IO.

So, NRTCachingDirectory puts these newly created files into a RAMDir,
and only when they are merged into a too-large segment, does it then
write-through to the real (delegate) directory.

This lets you spend some RAM to reduce I0.

Issue Links

• is blocked by: LUCENE-2793 Directory createOutput and openInput should take an IOContext