[LUCENENET-417] implement streams as field values

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Incomplete
• Component/s: Lucene.Net Core
• Assignee: Unassigned
• Reporter: Christopher Calvin Currens
• Created: 25/May/11 21:09
• Updated: 24/Jan/19 22:23
• Resolved: 24/Jan/19 22:23

Description

Adding binary values to a field is an expensive operation, as the whole binary data must be loaded into memory and then written to the index. Adding the ability to use a stream instead of a byte array could not only speed up the indexing process, but reducing the memory footprint as well.

Java lucene has the ability to use a TextReader the both analyze and store text in the index. Lucene.NET lacks the ability to store string data in the index via streams. This should be a feature added into Lucene .NET as well. My thoughts are to add another Field constructor, that is Field(string name, System.IO.Stream stream, System.Text.Encoding encoding), that will allow the text to be analyzed and stored into the index.

Comments about this approach are greatly appreciated.