[LUCENE-2740] PerFieldCodecWrapper causes crashes if not all per field codes have been used

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0-ALPHA
• Fix Version/s: 4.0-ALPHA
• Lucene Fields: New
• Assignee: Simon Willnauer
• Reporter: Simon Willnauer
• Created: 04/Nov/10 13:05
• Updated: 28/Aug/22 12:35
• Resolved: 10/Nov/10 16:53

Description

If a PerFieldCodecWrapper is used an SegmentMerger tries to merge two segments where one segment only has a subset of the field PerFieldCodecWrapper defines SegmentMerger tries to open non-existing files since Codec#files(Directory, SegmentInfo, Set<String>) blindly copies the expected files into the given set. This also hits exceptions in CheckIndex and addIndexes().
The reason for this is that PerFieldCodecWrapper simply iterates over the codecs it knows and adds all files without checking if they are present in the given Directory. We need to have some mechnanism that check if the "required" files for a codec are present and only add the files to the set if that field is really there.

Issue Links

• blocks: SOLR-1942 Ability to select codec per field
• is part of: LUCENE-2742 Enable native per-field codec support
• relates to: LUCENE-2742 Enable native per-field codec support