[LUCENE-9510] SortingStoredFieldsConsumer should use a format that has better random-access

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 8.7
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Adrien Grand
• Created: 06/Sep/20 21:06
• Updated: 28/Aug/22 16:07
• Resolved: 16/Sep/20 12:57

Description

We noticed some indexing rate regressions in Elasticsearch after upgrading to a new Lucene snapshot. This is due to the fact that SortingStoredFieldsConsumer is using the default codec to write stored fields on flush. Compression doesn't matter much for this case since these are temporary files that get removed on flush after the segment is sorted anyway so we could switch to a format that has faster random access.

Issue Links

• links to: GitHub Pull Request #1872
• links to: GitHub Pull Request #1874