[IGNITE-17274] Startup of large numbers of servers slowed by linear lookup in IgniteServiceProcessor

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.13
• Fix Version/s: 2.14
• Component/s: managed services
• Release Note: Improved service name lookup performance and reduced service startup time
• Ignite Flags: Release Notes Required
• Assignee: Arthur Naseef
• Reporter: Arthur Naseef
• Created: 29/Jun/22 17:52
• Updated: 09/Sep/22 16:41
• Resolved: 02/Jul/22 09:15

Description

Using a small POC, spinning up many servers is slow.  In addition, the startup time appears to be exponential.

Using timing measurements, found a linear lookup inside the IgniteServiceProcessor that is taking most of the time.

Replacing that linear lookup with a Map lookup, and maintaining the map, significantly speeds up the process, and startup time is now linear with the number of services started.

Note this was tested with 20K and 50K services on a 1-node ignite cluster.  Timings against the stock 2.13.0 code come in at 30s for 20K and 250s for 50K services.  Modifying the linear lookup to use a Map, the timing come in at 8s for 20K and 14s for 50K services.

 

Issue Links

• is cloned by: IGNITE-17524 Shutdown of large numbers of servers slowed by linear lookup in IgniteServiceProcessor
• links to: GitHub Pull Request #10123