[HBASE-1062] Compactions at (re)start on a large table can overwhelm DFS

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.19.0
• Component/s: regionserver
• Assignee: Andrew Kyle Purtell
• Reporter: Andrew Kyle Purtell
• Created: 14/Dec/08 12:42
• Updated: 16/Apr/13 01:19
• Resolved: 26/Dec/08 23:27

Description

Given a large table, > 1000 regions for example, if a cluster restart is necessary, the compactions undertaken by the regionservers when the master makes initial region assignments can overwhelm DFS, leading to file errors and data loss. This condition is exacerbated if write load was heavy before restart and so many regions want to split as soon as they are opened.