[OAK-6412] Consider upgrading to newer Lucene versions

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: lucene
• Assignee: Tommaso Teofili
• Reporter: Tommaso Teofili
• Created: 03/Jul/17 09:40
• Updated: 22/Mar/24 10:59

Description

An year ago I had started prototyping the upgrade to Lucene 5 [1], in the meantime version 6 (and 7 soon) has come out.
I think it'd be very nice to upgrade Lucene version to the latest, this would give us improvements in space consumption and runtime performance.
In case we want to upgrade to 6.0 or later we need to consider upgrade scenarios because Lucene Codecs are backward compatible with the previous major release, so Lucene 6 can read Lucene 5 but not Lucene 4.x (4.7 in our case) therefore we would need to detect that when reading an index and trigger reindexing using the new format.
Related to that there's also a patch to upgrade Solr index to version 5 (see OAK-4318).

[1] : https://github.com/tteofili/jackrabbit-oak/tree/lucene5

Issue Links

• is related to: OAK-5192 Reduce Lucene related growth of repository size
• relates to: OAK-3336 Abstract a full text index implementation to be extended by Lucene and Solr
• relates to: OAK-3150 Update Lucene to 6.x series
• relates to: OAK-10713 oak-lucene: add test coverage for stack overflow based on very long and complex regexp
• relates to: OAK-10716 oak-lucene: update to version 4.7.2 (latest from that branch)