[LUCENE-3924] Optimize buffer size handling in RAMDirectory to make it more GC friendly

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 4.0-ALPHA
• Component/s: core/store
• Lucene Fields: New
• Assignee: Uwe Schindler
• Reporter: Uwe Schindler
• Created: 26/Mar/12 15:38
• Updated: 28/Aug/22 13:12
• Resolved: 09/Nov/18 23:05

Description

RAMDirectory currently uses a fixed buffer size of 1024 bytes to allocate memory. This is very wasteful for large indexes. Improvements may be:

• per file buffer sizes based on IOContext and maximum segment size
• allocate only one buffer for files that are copied from another directory
• dynamically increae buffer size when files grow (makes seek() complicated)

Sub-Tasks

• Allow per-RAMFile buffer sizes based on IOContext and source of data (e.g. copy from another directory): Closed
• Improve Javadocs of RAMDirectory to document its limitations: Resolved