[HBASE-27766] Support steal job queue mode for read RPC queues of RWQueueRpcExecutor

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-alpha-3, 2.5.3
• Component/s: rpc
• Assignee: Xiaolin Ha
• Reporter: Xiaolin Ha
• Created: 30/Mar/23 04:14
• Updated: 09/Oct/23 14:11

Description

Currently, the RPC queues are distinguished by request type, under most circumstances of RWQueueRpcExecutor, there are write queues and read queues, while reads queues are always divided by get requests and scan requests. The reason why we isolate the scan requests and get requests is that we do not want large scans block small gets.

Since the handler resources for a regionserver is limited and we can't dynamicly change the handler ratio by the ratio of requests. We should both keep large scan and the small gets be isolated, and let the idle handlers for the samller ratio scans to handle some gets when the gets handlers are busy.

This steal queue idea can also be used in other circumstances, e.g. idle read handler steal jobs from write queus. 

Issue Links

• links to: GitHub Pull Request #5260