[KUDU-3556] Auto-tune number of worker threads per Kudu server's RPC interface

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: master, server, tserver
• Assignee: Unassigned
• Reporter: Alexey Serbin
• Created: 21/Feb/24 20:03
• Updated: 21/Feb/24 20:03

Description

As of now, the value for the --rpc_num_service_threads flag is hard-coded (but is different for masters vs tablet servers). A manual tuning is required to enable more efficient utilization of the available CPU cores/threads by Kudu servers. It would be nice to have a mode when the number of worker RPC threads is adaptively configured to be 80% of all the available CPU cores/threads. The exact utilization ratio of CPU cores for RPC workers might be a parameter defined by a new flag with default value of 0.8.