[HDFS-5140] Too many safemode monitor threads being created in the standby namenode causing it to fail with out of memory error

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.1.0-beta
• Fix Version/s: 2.1.1-beta
• Component/s: ha
• Target Version/s: 2.1.1-beta
• Hadoop Flags: Reviewed
• Assignee: Jing Zhao
• Reporter: Arpit Gupta
• Created: 28/Aug/13 18:01
• Updated: 24/Sep/13 23:33
• Resolved: 30/Aug/13 07:50

Description

While running namenode load generator with 100 threads for 10 mins namenode was being failed over ever 2 mins.
The standby namenode shut itself down as it ran out of memory and was not able to create another thread.
When we searched for 'Safe mode extension entered' in the standby log it was present 55000+ times