[LUCENE-2340] FixedIntBlockIndexOutput encodes unnecessary integers at the end of a list

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 4.0-ALPHA
• Fix Version/s: 4.9, 6.0
• Component/s: core/index
• Labels: dead
• Lucene Fields: New
• Assignee: Unassigned
• Reporter: Renaud Delbru
• Created: 22/Mar/10 18:01
• Updated: 28/Aug/22 12:22

Description

At closing time, the current FixedIntBlockIndexOutput flushes blocks of blockSize even if there is only a few integers in the block.
This can be problematic and causes a big overhead when using large blockSize (e.g., 1024), on small segments or on rare term posting list.

One solution will be to have a secondary flushBlock method with an additional paramter: the valid length of a buffer. This method will be only called in the FixedIntBlockIndexOutput#close() method.
The way this particular block of integers are encoded are left to subclasses.