[OAK-7122] Implement script to compare lucene indexes logically

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Done
• Fix Version/s: 1.8.0
• Component/s: run
• Assignee: Chetan Mehrotra
• Reporter: Chetan Mehrotra
• Created: 05/Jan/18 08:54
• Updated: 12/Jan/18 12:00
• Resolved: 05/Jan/18 10:51

Description

With Document Traversal based indexing we have implemented a newer indexing logic. To validate that index produced by it is is same as one done by existing indexing flow we need to implement a script which can enable comparing the index content logically

This was recently discussed on lucene mailing list [1] and suggestion there was it can be done by un-inverting the index. So to enable that we need to implement a script which can

1. Open a Lucene index
2. Map the Lucene Document to path of node
3. For each document determine what all fields are associated with it (stored and non stored)
4. Dump this content in file sorted by path and for each line field name sorted by name

Then such dumps can be generated for old and new index and compared via simple text diff

[1] http://lucene.markmail.org/thread/wt22gk6aufs4uz55

Issue Links

• is related to: OAK-7123 ChildNodeStateProvider does not return all immediate children