[SOLR-310] Deleting pending handling can cause OOM

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3
• Assignee: Mike Klaas
• Reporter: Mike Klaas
• Created: 19/Jul/07 00:15
• Updated: 10/May/13 10:39
• Resolved: 04/Sep/07 23:06

Description

> Mike:
>> Could happen when doDeleting the pending docs too. James: try
>> sending commit every 500k docs or so.

Yonik:
> Hmmm, right... some of the memory usage will be related to the treemap
> keeping track of deleted items, and some of it will be related to the
> reader itself (the term index, and the norms).

> Perhaps we should have some sort of limit on the number of deletions
> we cache so people don't have to worry about that part.

Good idea. Perhaps a solrconfig.xml setting, <maxPendingDocs>? Default to 100k?