[IGNITE-12684] Optimize count of threads for rebuild indexes

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9
• Assignee: Kirill Tkalenko
• Reporter: Kirill Tkalenko
• Reviewer: Alexey Scherbakov
• Created: 14/Feb/20 22:31
• Updated: 05/Mar/20 08:44
• Resolved: 21/Feb/20 08:45

Description

We were recently implemented the new property INDEX_REBUILDING_PARALLELISM (by issue IGNITE-11979).
That fix do possible to rebuild indexes, after restart without index.bin or restore from snapshot to another topology, in parallel threads.
But now the process of rebuild can to consume a lot of threads, which limited on INDEX_REBUILDING_PARALLELISM * AVAILABLE_PROC_CNT (count of thread in public pool).
For example in case of INDEX_REBUILDING_PARALLELISM = 28 and 64 CPU it will be more then 1.5К threads.

Look at the method, it will create dedicate thread on each invocation `org.apache.ignite.internal.processors.query.schema.SchemaIndexCacheVisitorImpl#processPartitionsAsync`

Issue Links

• is blocked by: IGNITE-12750 Correct the setting of the pool to build the index
• links to: GitHub Pull Request #7432