[LUCENE-652] Compressed fields should be "externalized" (from Fields into Document)

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.9, 2.0.0, 2.1
• Fix Version/s: 2.9
• Component/s: core/index
• Assignee: Michael McCandless
• Reporter: Michael McCandless
• Created: 14/Aug/06 18:39
• Updated: 28/Aug/22 11:30
• Resolved: 28/Mar/09 19:13

Description

Right now, as of 2.0 release, Lucene supports compressed stored fields. However, after discussion on java-dev, the suggestion arose, from Robert Engels, that it would be better if this logic were moved into the Document level. This way the indexing level just stores opaque binary fields, and then Document handles compress/uncompressing as needed.

This approach would have prevented issues like LUCENE-629 because merging of segments would never need to decompress.

See this thread for the recent discussion:

http://www.gossamer-threads.com/lists/lucene/java-dev/38836

When we do this we should also work on related issue LUCENE-648.