[OAK-5558] Consistency checker for Lucene indexes

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.7.0, 1.8.0
• Component/s: lucene
• Epic Link: indexer resilience
• Assignee: Chetan Mehrotra
• Reporter: Chetan Mehrotra
• Created: 01/Feb/17 05:19
• Updated: 08/Oct/19 15:22
• Resolved: 09/May/17 11:49

Description

We should add support for some form of consistency checker for Lucene indexes present in the system. These should be exposed as part of LuceneIndexMBean

boolean checkAllIndexes()
String checkIndexForConsistency(String indexPath)

As part of this check we can provide 2 modes

1. Normal - Under this consistency check logic would
   1. lookup index file names as stored under dirListing
   2. see if all those files are valid i.e. nodestate corresponding to those filenames are present
   3. see if blobIds referred by those file nodes are present and there length match the expected size
2. Deep - Under this we use CheckIndex tool from Lucene

Issue Links

• is related to: OAK-6075 Oak run console script to check index consistency