[OAK-1456] Non-blocking reindexing

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.20
• Component/s: query
• Labels: production resilience
• Assignee: Alex Deparvu
• Reporter: Michael Marth
• Created: 21/Feb/14 13:49
• Updated: 31/Jan/17 08:15
• Resolved: 02/Apr/14 14:40

Description

For huge Oak repos it will be essential to re-index some or all indexes in case they go out of sync in a non-blocking way (i.e. the repo is still operation while the re-indexing takes place).

For an asynchronous index this should not be much of a problem. One could drop it and recreate (as an added benefit it might be nice if the user could simply add a property "reindex" to the index definition node to trigger this).

For synchronous indexes, I suggest the mechanism creates an asynchronous index behind the scenes first and once it has caught up

• blocks writes
• removes the existing synchronous index
• moves asynchronous index in its place and makes it synchronous

Issue Links

• is related to: OAK-5553 Index async index in a new lane without blocking the main lane