[HDFS-11411] Avoid OutOfMemoryError in TestMaintenanceState test runs

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha1
• Fix Version/s: 2.9.0, 3.0.0-alpha4
• Component/s: datanode, namenode
• Target Version/s: 3.0.0-alpha4
• Hadoop Flags: Reviewed
• Assignee: Manoj Govindassamy
• Reporter: Manoj Govindassamy
• Created: 14/Feb/17 01:21
• Updated: 22/Feb/17 18:13
• Resolved: 22/Feb/17 17:49

Description

TestMainteananceState test runs are seeing OutOfMemoryError issues quite frequently now. Need to fix tests that are consuming lots of memory/threads.

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.apache.hadoop.hdfs.TestMaintenanceState
Tests run: 21, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 219.479 sec <<< FAILURE! - in org.apache.hadoop.hdfs.Te
testTransitionFromDecommissioned(org.apache.hadoop.hdfs.TestMaintenanceState)  Time elapsed: 0.64 sec  <<< ERROR!
java.lang.OutOfMemoryError: unable to create new native thread
testTakeDeadNodeOutOfMaintenance(org.apache.hadoop.hdfs.TestMaintenanceState)  Time elapsed: 0.031 sec  <<< ERROR!
java.lang.OutOfMemoryError: unable to create new native thread
testWithNNAndDNRestart(org.apache.hadoop.hdfs.TestMaintenanceState)  Time elapsed: 0.03 sec  <<< ERROR!
java.lang.OutOfMemoryError: unable to create new native thread
testMultipleNodesMaintenance(org.apache.hadoop.hdfs.TestMaintenanceState)  Time elapsed: 60.127 sec  <<< ERROR!
java.io.IOException: Problem starting http server
Results :
Tests in error: 
  TestMaintenanceState.testTransitionFromDecommissioned:225->AdminStatesBaseTest.startCluster:413->AdminStatesBaseTest.s
  TestMaintenanceState.testTakeDeadNodeOutOfMaintenance:636->AdminStatesBaseTest.startCluster:413->AdminStatesBaseTest.s
  TestMaintenanceState.testWithNNAndDNRestart:692->AdminStatesBaseTest.startCluster:413->AdminStatesBaseTest.startCluste
  TestMaintenanceState.testMultipleNodesMaintenance:532->AdminStatesBaseTest.startCluster:413->AdminStatesBaseTest.start