[LUCENE-5046] Explore preset dictionaries for CompressingStoredFieldsFormat

• Type: Improvement
• Status: Closed
• Priority: Trivial
• Resolution: Duplicate
• Lucene Fields: New
• Assignee: Adrien Grand
• Reporter: Adrien Grand
• Created: 09/Jun/13 09:26
• Updated: 28/Aug/22 13:47
• Resolved: 29/Aug/14 17:15

Description

I discussed this possible improvement with Stefan Pohl and Andrzej Białecki at Berlin Buzzwords: By having preset dictionaries (which could be user-provided and/or computed on a per-block basis), decompression could be faster since we would never have to decompress several documents from a block in order to access a single document.

One drawback is that it would require putting some boundaries in the compressed stream, so it would maybe decrease a little the compression ratio. But then if decompression is faster, we could also afford larger blocks, so I think this is worth exploring.

Issue Links

• is superceded by: LUCENE-5914 More options for stored fields compression