[HBASE-20786] Table create with thousands of regions takes too long

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Component/s: Performance
• Assignee: Unassigned
• Reporter: Michael Stack
• Created: 25/Jun/18 20:54
• Updated: 11/Jun/22 19:24
• Resolved: 11/Jun/22 19:24

Description

Internal testing has create of a table with 33k regions taking 18 minutes. Let me provide more info below. We have an executor with default ten threads handling the creation of the regions in HDFS which helps distribute out the load but its not enough. This cluster had >600 servers. Let me add detail.

Need to spend some time on speeding up create/assigns. Made this an umbrella issue so can pick off pieces of the problem as subtasks.