[OAK-4566] Multiplexing store support in Lucene Indexes

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.8, 1.6.0
• Component/s: lucene
• Epic Link: Multiplexing Repository
• Assignee: Chetan Mehrotra
• Reporter: Chetan Mehrotra
• Created: 18/Jul/16 06:19
• Updated: 08/Oct/19 15:21
• Resolved: 04/Aug/16 09:52

Description

Similar to OAK-3403 we need support multiplexing store in Lucene indexes. This can be done by having multiple directories under given index definition.

For e.g. currently the Lucene indexes for an index /oak:index/assetIndex are stored in node /oak:index/assetIndex/:dir. For supporting multiple indexes which get stored in different stores we can have structure like

/oak:index/assetIndex
     + :oak:mount1-dir
     + :dir

In above structure index content for paths which are part of mount1 would be store in Lucene files stores under :oak:mount1-dir while the rest go in default location {{:dir}

1. Writing - At the time of indexing the LuceneIndexEditor should pick up correct writer i.e. one which is mapped to right directory node in repository
2. Reading - For reading we would have one IndexSearcher per directory node and then query would be executed against both and a joined cursor would be made

Issue Links

• blocks: OAK-4412 Lucene hybrid index
• is blocked by: OAK-4616 Record suggestor status in suggest-data node
• is related to: OAK-4643 Support multiple readers in suggester, spellcheck and faceted search
• is related to: OAK-4644 Support multiple readers in LuceneIndexMBean
• is related to: OAK-4607 Add support for multiple directory in IndexCopier
• relates to: OAK-3402 Multiplexing NodeStore support in Oak layer