[HBASE-1583] Start/Stop of large cluster untenable

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.20.0
• Hadoop Flags: Reviewed
• Release Note: No compaction on disable or shutdown of cluster. No disable on open or enable unless the region has references.
• Assignee: Michael Stack
• Reporter: Michael Stack
• Created: 25/Jun/09 01:05
• Updated: 13/Sep/09 22:24
• Resolved: 16/Jul/09 23:30

Description

Starting and stopping a loaded large cluster is way too flakey and takes too long. This is 0.19.x but same issues apply to TRUNK I'd say.

At pset with our > 100 nodes carrying 6k regions:

+ shutdown takes way too long.... maybe ten minutes or so. We compact regions inline with shutdown. We should just go down. It doesn't seem like all regionservers go down everytime either.
+ startup is a mess with our assigning out regions an rebalancing at same time. By time that the compactions on open run, it can be near an hour before whole thing settles down and becomes useable