[#LUCENE-1044] Behavior on hard power shutdown

Lucene - Java

Behavior on hard power shutdown

Created: 02/Nov/07 07:07 PM Updated: 23/Feb/09 05:15 PM

Return to search

Component/s:

Index

Affects Version/s:

None

Fix Version/s:

2.4

Time Tracking:

Not Specified

File Attachments:

File Name	Date Attached	Attached By	Size
FSyncPerfTest.java	2007-11-22 02:16 PM	Doron Cohen	6 kB
LUCENE-1044.patch	2007-11-04 03:28 PM	Michael McCandless	6 kB
LUCENE-1044.take2.patch	2007-11-04 06:29 PM	Michael McCandless	7 kB
LUCENE-1044.take3.patch	2007-11-06 10:38 PM	Michael McCandless	16 kB
LUCENE-1044.take4.patch	2007-11-27 08:14 PM	Michael McCandless	7 kB
LUCENE-1044.take5.patch	2007-12-11 08:20 PM	Michael McCandless	86 kB
LUCENE-1044.take6.patch	2008-02-05 10:52 AM	Michael McCandless	194 kB
LUCENE-1044.take7.patch	2008-02-05 09:19 PM	Michael McCandless	205 kB
LUCENE-1044.take8.patch	2008-02-08 08:31 PM	Michael McCandless	206 kB

Environment:

Windows Server 2003, Standard Edition, Sun Hotspot Java 1.5

Lucene Fields:	New
Resolution Date:	11/Feb/08 06:59 PM

Description

« Hide

When indexing a large number of documents, upon a hard power failure (e.g. pull the power cord), the index seems to get corrupted. We start a Java application as an Windows Service, and feed it documents. In some cases (after an index size of 1.7GB, with 30-40 index segment .cfs files) , the following is observed.

The 'segments' file contains only zeros. Its size is 265 bytes - all bytes are zeros.
The 'deleted' file also contains only zeros. Its size is 85 bytes - all bytes are zeros.

Before corruption, the segments file and deleted file appear to be correct. After this corruption, the index is corrupted and lost.

This is a problem observed in Lucene 1.4.3. We are not able to upgrade our customer deployments to 1.9 or later version, but would be happy to back-port a patch, if the patch is small enough and if this problem is already solved.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Hoss Man made changes - 03/Nov/07 05:23 AM

Field	Original Value	New Value
Fix Version/s	1.9 [ 12310334 ]
Resolution		Invalid [ 6 ]
Status	Open [ 1 ]	Resolved [ 5 ]

Hoss Man made changes - 03/Nov/07 05:23 AM

Affects Version/s

1.9 [ 12310334 ]

Michael McCandless made changes - 04/Nov/07 10:34 AM

Assignee		Michael McCandless [ mikemccand ]
Status	Resolved [ 5 ]	Reopened [ 4 ]
Resolution	Invalid [ 6 ]

Michael McCandless made changes - 04/Nov/07 03:28 PM

Attachment

LUCENE-1044.patch [ 12368942 ]

Michael McCandless made changes - 04/Nov/07 06:29 PM

Attachment

LUCENE-1044.take2.patch [ 12368948 ]

Michael McCandless made changes - 06/Nov/07 10:38 PM

Attachment

LUCENE-1044.take3.patch [ 12369061 ]

Michael McCandless made changes - 10/Nov/07 05:51 PM

Fix Version/s		2.3 [ 12312531 ]
Resolution		Fixed [ 1 ]
Status	Reopened [ 4 ]	Resolved [ 5 ]

Michael McCandless made changes - 13/Nov/07 09:53 PM

Status	Resolved [ 5 ]	Reopened [ 4 ]
Resolution	Fixed [ 1 ]

Doron Cohen made changes - 22/Nov/07 02:16 PM

Attachment

FSyncPerfTest.java [ 12370069 ]

Michael McCandless made changes - 27/Nov/07 08:14 PM

Attachment

LUCENE-1044.take4.patch [ 12370344 ]

Michael McCandless made changes - 06/Dec/07 05:27 PM

Fix Version/s	2.3 [ 12312531 ]
Fix Version/s		2.4 [ 12312681 ]

Michael McCandless made changes - 11/Dec/07 08:20 PM

Attachment

LUCENE-1044.take5.patch [ 12371455 ]

Michael McCandless made changes - 05/Feb/08 10:52 AM

Attachment

LUCENE-1044.take6.patch [ 12374759 ]

Michael McCandless made changes - 05/Feb/08 09:19 PM

Attachment

LUCENE-1044.take7.patch [ 12374819 ]

Michael McCandless made changes - 08/Feb/08 08:31 PM

Attachment

LUCENE-1044.take8.patch [ 12375106 ]

Michael McCandless made changes - 11/Feb/08 06:59 PM

Status	Reopened [ 4 ]	Resolved [ 5 ]
Resolution		Fixed [ 1 ]

Michael McCandless made changes - 11/Oct/08 12:49 PM

Status

Resolved [ 5 ]

Closed [ 6 ]