[SOLR-2356] indexing using DataImportHandler does not use entire CPU capacities

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 4.0-ALPHA
• Component/s: update
• Labels: test

Environment

intel xeon processor (4 cores), Debian Linux Lenny, OpenJDK 64bits server v1.6.0

• Assignee: Unassigned
• Reporter: colby
• Created: 10/Feb/11 14:23
• Updated: 29/Aug/20 18:34
• Resolved: 29/Aug/20 18:34

Description

When I use a DataImportHandler to index a large number of documents (~35M), cpu usage doesn't go over than 100% cpu (i.e. just one core).
When I configure 4 threads for the <entity> tag, the cpu usage is splitted to 25% per core but never use 400% of cpu (i.e 100% of the 4 cores)

I use solr embedded with jetty server.
Is there a way to tune this feature in order to use all cores and improve indexing performances ?
Because for the moment, an extra script (PHP) gives better indexing performances than DIH.

thanks

Issue Links

• is superceded by: SOLR-14783 Remove DIH from 9.0