[HBASE-3947] SplitLog in HMaster spend long time, move it to regionserver

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 0.90.4
• Component/s: master, regionserver, Zookeeper
• Assignee: Unassigned
• Reporter: mingjian
• Created: 02/Jun/11 03:16
• Updated: 20/Nov/15 12:42
• Resolved: 02/Jun/11 03:23

Description

One of our 100 nodes cluster crashed by namenode crash.
We restarted and found it spend about two and a half hours to split hlogs.
After crashed, there are about 3,500 hfiles in /hbase/.logs/. Split 1 of them need about 2~3 seconds.

SplitLog works in a single thread of HMaster. Why not move it to regionservers? And HMaster only creates split plans and notifies regionserver through zookeeper.