[LUCENE-4871] Sorter API: better compress positions, offsets and payloads in SortingDocsAndPositionsEnum

• Type: Improvement
• Status: Closed
• Priority: Trivial
• Resolution: Fixed
• Fix Version/s: 4.3
• Lucene Fields: New
• Assignee: Adrien Grand
• Reporter: Adrien Grand
• Created: 22/Mar/13 14:05
• Updated: 28/Aug/22 13:42
• Resolved: 22/Mar/13 15:09

Description

SortingDocsAndPositionsEnum could easily save memory by using a Lucene40TCF-like compression method for positions, offsets and payloads:

• delta-encode positions and startOffsets (with the previous end offset),
• store the length of the tokens instead of their end offset (endOffset == startOffset + length),
• use a single bit to say whether the token has a payload.

Issue Links

• is related to: LUCENE-3918 Port index sorter to trunk APIs