[SOLR-1806] Extend statistics provided by DIH components

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 1.5
• Fix Version/s: 4.9, 6.0
• Component/s: contrib - DataImportHandler
• Labels: dih indexing monitoring statistics

Environment

java 6, tomcat 6.0.x

• Assignee: Unassigned
• Reporter: Michael Henson
• Created: 05/Mar/10 02:28
• Updated: 29/Aug/20 18:30
• Resolved: 29/Aug/20 18:30

Description

It would be useful to get more information from the DIH during an indexing run. The initial requirements for this patch are:

1. Add a cumulative "documents per second" calculation for the currently-running index process
2. Add the ability for each EntityProcessor to report its own custom statistics in a manner appropriate to the nature of its work

For example, the SQLEntityProcessor might show the total number of queries performed, the average time to execute each of those queries, the total amount of time it spent executing its queries, etc.

The CachedSQLEntityProcessor might show cache hit counts, cache miss counts, the current size of the cache, etc.

Issue Links

• is superceded by: SOLR-14783 Remove DIH from 9.0