[OAK-6148] Warning if there are many Lucene documents

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Fix Version/s: 1.10.0
• Component/s: lucene, query
• Epic Link: indexer resilience
• Assignee: Unassigned
• Reporter: Thomas Mueller
• Created: 02/May/17 11:56
• Updated: 10/Jul/19 09:13
• Resolved: 01/Dec/17 08:03

Description

Lucene indexes are limited to Integer.MAX_VALUE (LUCENE-4104), so Lucene indexes can have at most around 2 billion nodes indexed.

We should avoid running into this limit. For example, we could log a warning if the number of documents is a multiple of 200 million, so a user has plenty of time to change the index configuration.

Also, it would be good to be able to read the current number of documents per index (using JMX for example), so that one can find out how far he is from the limit.