Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
-
New
Description
I am watching a nightly benchmark run slowly run its CheckIndex step, using a single core out of the 128 cores the box has.
It seems like this is an embarrassingly parallel problem, if the index has multiple segments, and would finish much more quickly on concurrent hardware if we did "thread per segment".
If wanted to get even further concurrency, each part of the Lucene index that is checked is also independent, so it could be "thread per segment per part".