[JCR-2219] Improved background text extraction

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0-alpha7
• Component/s: indexing, jackrabbit-core
• Assignee: Unassigned
• Reporter: Jukka Zitting
• Created: 16/Jul/09 14:52
• Updated: 13/Aug/09 15:01
• Resolved: 31/Jul/09 13:46

Description

As recently discussed on the mailing list (see http://markmail.org/message/syt7lc2guzapt7la), the current approach to text extraction in background threads doesn't work that well especially with the Tika-based extractors that support streamed parsing of many document types.

Also, we currently all of the extracted text streams are buffered into Strings before being passed into the Lucene index. It would be good if we could somehow get back to passing just Readers to Lucene.