[HBASE-16707] [Umbrella] Improve throttling feature for production usage

• Type: Umbrella
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Assignee: Yi Mei
• Reporter: Guanghao Zhang
• Created: 26/Sep/16 12:36
• Updated: 11/Jun/22 18:26
• Resolved: 11/Jun/22 18:26

Description

HBASE-11598 add rpc throttling feature and did a great initial work there. We plan to use throttling in our production cluster and did some improvements for it. From the user mail list, I found that there are other users used throttling feature, too. I thought it is time to contribute our work to community, include:
1. Add shell cmd to start/stop throttling.
2. Add metrics for throttling request.
3. Basic UI support in master/regionserver.
4. Handle throttling exception in client.
5. Add more throttle types like DynamoDB, use read/write capacity unit to throttle.
6. Support soft limit, user can over consume his quota when regionserver has available capacity because other users not consume at the same time.
7. ... ...

I thought some of these improvements are useful. So open an umbrella issue to track. Suggestions and discussions are welcomed.

Sub-Tasks

• Add new throttle type: read/write capacity unit: Resolved
• Support set region server quota and allow exceed user/table/ns quota when rs has available quota: Resolved
• Add shell command to switch throttle on or off: Resolved
• Fix wrong throttling exception for capacity unit: Resolved
• Support set region server throttle quota: Resolved
• Support exceed user/table/ns throttle quota if region server has available quota: Resolved
• Implement CLUSTER quota scope: Resolved
• Make CLUSTER scope quota work right when use rs group: Open
• Show table throttle quotas in table jsp: Resolved
• Show quota infos in master UI: Resolved