[#LUCENE-1197] IndexWriter can flush too early when flushing by RAM usage

Lucene - Java

IndexWriter can flush too early when flushing by RAM usage

Created: 29/Feb/08 12:38 PM Updated: 08/May/08 07:47 PM

Return to search

Component/s:

Index

Affects Version/s:

2.3

Fix Version/s:

2.3.2, 2.4

Time Tracking:

Not Specified

Lucene Fields:	New
Resolution Date:	29/Feb/08 12:42 PM

Description

« Hide

There is a silly bug in how DocumentsWriter tracks its RAM usage:
whenever term vectors are enabled, it incorrectly counts the space
used by term vectors towards flushing, when in fact this space is
recycled per document.

This is not a functionality bug. All it causes is flushes to happen
too frequently, and, IndexWriter will use less RAM than you asked it
to. To work around it you can simply give it a bigger RAM buffer.

I will commit a fix shortly.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Michael McCandless made changes - 29/Feb/08 12:42 PM

Field	Original Value	New Value
Resolution		Fixed [ 1 ]
Status	Open [ 1 ]	Resolved [ 5 ]

Repository	Revision	Date	User	Message
ASF	#632306	Fri Feb 29 12:42:47 UTC 2008	mikemccand	~~LUCENE-1197~~: fix DocumentsWriter to not overcount RAM usage when term vectors are on
				Files Changed
				MODIFY /lucene/java/trunk/src/java/org/apache/lucene/index/DocumentsWriter.java

Repository	Revision	Date	User	Message
ASF	#635863	Tue Mar 11 10:02:42 UTC 2008	mikemccand	~~LUCENE-1197~~ (porting to 2.3): fix IndexWriter to not flush by RAM too early when TermVectors are in use
				Files Changed
				MODIFY /lucene/java/branches/lucene_2_3/src/java/org/apache/lucene/index/DocumentsWriter.java MODIFY /lucene/java/branches/lucene_2_3/CHANGES.txt

[ Permlink | « Hide ]

Hoss Man added a comment - 11/Mar/08 07:27 PM

targeted for 2.3.2 bug fix release

Hoss Man made changes - 11/Mar/08 07:27 PM

Fix Version/s

2.3.2 [ 12313057 ]

Michael Busch made changes - 08/May/08 07:47 PM

Status

Resolved [ 5 ]

Closed [ 6 ]