Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7877 [Umbrella] Support maintenance state for datanodes
  3. HDFS-11411

Avoid OutOfMemoryError in TestMaintenanceState test runs

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 2.9.0, 3.0.0-alpha4
    • Component/s: datanode, namenode
    • Labels:
      None

      Description

      TestMainteananceState test runs are seeing OutOfMemoryError issues quite frequently now. Need to fix tests that are consuming lots of memory/threads.

      -------------------------------------------------------
       T E S T S
      -------------------------------------------------------
      Running org.apache.hadoop.hdfs.TestMaintenanceState
      Tests run: 21, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 219.479 sec <<< FAILURE! - in org.apache.hadoop.hdfs.Te
      testTransitionFromDecommissioned(org.apache.hadoop.hdfs.TestMaintenanceState)  Time elapsed: 0.64 sec  <<< ERROR!
      java.lang.OutOfMemoryError: unable to create new native thread
      testTakeDeadNodeOutOfMaintenance(org.apache.hadoop.hdfs.TestMaintenanceState)  Time elapsed: 0.031 sec  <<< ERROR!
      java.lang.OutOfMemoryError: unable to create new native thread
      testWithNNAndDNRestart(org.apache.hadoop.hdfs.TestMaintenanceState)  Time elapsed: 0.03 sec  <<< ERROR!
      java.lang.OutOfMemoryError: unable to create new native thread
      testMultipleNodesMaintenance(org.apache.hadoop.hdfs.TestMaintenanceState)  Time elapsed: 60.127 sec  <<< ERROR!
      java.io.IOException: Problem starting http server
      Results :
      Tests in error: 
        TestMaintenanceState.testTransitionFromDecommissioned:225->AdminStatesBaseTest.startCluster:413->AdminStatesBaseTest.s
        TestMaintenanceState.testTakeDeadNodeOutOfMaintenance:636->AdminStatesBaseTest.startCluster:413->AdminStatesBaseTest.s
        TestMaintenanceState.testWithNNAndDNRestart:692->AdminStatesBaseTest.startCluster:413->AdminStatesBaseTest.startCluste
        TestMaintenanceState.testMultipleNodesMaintenance:532->AdminStatesBaseTest.startCluster:413->AdminStatesBaseTest.start
      

        Attachments

        1. HDFS-11411.02.patch
          2 kB
          Manoj Govindassamy
        2. HDFS-11411.01.patch
          2 kB
          Manoj Govindassamy

          Activity

            People

            • Assignee:
              manojg Manoj Govindassamy
              Reporter:
              manojg Manoj Govindassamy
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: