[OAK-10055] Auto refreshing IndexTracker every hour causes online reindexing to fail

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.22.9
• Fix Version/s: 1.22.14, 1.48.0
• Labels: lucene
• Assignee: Thomas Mueller
• Reporter: Thomas Mueller
• Created: 06/Jan/23 08:52
• Updated: 19/Jan/23 14:48
• Resolved: 09/Jan/23 12:30

Description

Auto refreshing the index tracker every one hour https://github.com/apache/jackrabbit-oak/commit/37a6d47b27cd7393812fa34c23b5dc68170daef3 , which was done to fix potential SNFE issue seems to be causing online reindexing for those indexes that take more than an hour to reindex to fail.

In addition to reindexing, it looks like there is another scenario whenever a default 1h auto-refreshing IndexTracker results in an error, even thought it doesn't seem to be as severe:

Caused by: java.io.FileNotFoundException: _b.dvd
	at org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:261)
	at org.apache.lucene.store.NRTCachingDirectory.fileLength(NRTCachingDirectory.java:178)
	at org.apache.jackrabbit.oak.plugins.index.lucene.directory.DirectoryUtils.dirSize(DirectoryUtils.java:61)
	at org.apache.jackrabbit.oak.plugins.index.lucene.hybrid.NRTIndex$NRTReader.getIndexSize(NRTIndex.java:382)
	at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexMBeanImpl.getIndexSize(LuceneIndexMBeanImpl.java:840)
	at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexMBeanImpl.access$400(LuceneIndexMBeanImpl.java:98)
	at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexMBeanImpl$IndexStats.<init>(LuceneIndexMBeanImpl.java:746)
	at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexMBeanImpl.getIndexStats(LuceneIndexMBeanImpl.java:131)
	at sun.reflect.GeneratedMethodAccessor522.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:71)
	at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:275)
	at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:112)
	at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:46)
	at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:237)
	... 13 common frames omitted 

Issue Links

• is caused by: OAK-9540 SegmentNotFoundException in IndexDefinition.hasMatchingNodeTypeReg
• links to: GitHub Pull Request #814