[LUCENE-8735] FileAlreadyExistsException after opening old commit

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 8.0
• Fix Version/s: 7.7.1, 7.7.2, 8.0.1, 8.1, 9.0
• Component/s: core/store
• Lucene Fields: New
• Assignee: Simon Willnauer
• Reporter: Henning Andersen
• Created: 22/Mar/19 16:47
• Updated: 28/Aug/22 15:43
• Resolved: 26/Mar/19 14:58

Description

FilterDirectory.getPendingDeletes() does not delegate calls. This in turn means that IndexFileDeleter does not consider those as relevant files.

When opening an IndexWriter for an older commit, excess files are attempted deleted. If an IndexReader exists using one of the newer commits, the excess files may fail to delete (at least on windows or when using the mocking WindowsFS).

If then closing and opening the IndexWriter, the information on the pending deletes are gone if a FilterDirectory derivate is used. At the same time, the pending deletes are filtered out of listAll. This leads to a risk of hitting an existing file name, causing a FileAlreadyExistsException.

This issue likely only exists on windows.

Will create pull request with fix.

Issue Links

• relates to: LUCENE-8734 nextWriteDelGen of SegmentCommitInfo should be persisted
• links to: GitHub Pull Request #619