[LUCENE-1750] Create a MergePolicy that limits the maximum size of it's segments

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 2.4.1
• Fix Version/s: 3.2, 4.0-ALPHA
• Component/s: core/index
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Jason Rutherglen
• Created: 16/Jul/09 22:27
• Updated: 28/Aug/22 12:04
• Resolved: 20/Mar/12 15:57

Description

Basically I'm trying to create largish 2-4GB shards using
LogByteSizeMergePolicy, however I've found in the attached unit
test segments that exceed maxMergeMB.

The goal is for segments to be merged up to 2GB, then all
merging to that segment stops, and then another 2GB segment is
created. This helps when replicating in Solr where if a single
optimized 60GB segment is created, the machine stops working due
to IO and CPU starvation.