[LUCENE-7323] Compound file writing should verify checksum of its sub-files

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 6.2, 7.0
• Lucene Fields: New
• Assignee: Michael McCandless
• Reporter: Michael McCandless
• Created: 08/Jun/16 21:55
• Updated: 28/Aug/22 14:59
• Resolved: 09/Jun/16 18:54

Description

For larger segments, there is a non-trivial window, from when IW
writes sub-files, to when it then builds the CFS, during which the
files can become corrupted (from external process, bad filesystem,
hardware, etc.)

Today we quietly build the CFS even if the sub-files are corrupted,
but we can easily detect it, letting users catch corruption earlier
(write time instead of read time).

Issue Links

• breaks: SOLR-9596 <fieldType ... (postings|docValues)Format="SimpleText"> stopped working in Solr 6.2