Details
-
Improvement
-
Status: Reopened
-
Minor
-
Resolution: Fixed
-
None
-
None
-
None
-
New
Description
Doc values terms dictionaries split data into blocks of 64 terms, where the first term is written uncompressed (which is useful for binary searches), and the 63 other terms are encoded by taking the difference with the previous term and compressing all suffixes together with LZ4.
With this format, the suffix of the second term is also unlikely to benefit from any compression, since it doesn't have data to search for duplicate bytes into besides itself. A minor improvement we could make would consist of using the first term as a dictionary for suffixes of terms 2..64.
Attachments
Issue Links
- links to
