Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5260

Job failed because of JvmManager running into inconsistent state

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.1.2
    • 1.2.1
    • tasktracker
    • None

    Description

      In our cluster, jobs failed due to randomly task initialization failed because of JvmManager running into inconsistent state and TaskTracker failed to exit:

      java.lang.Throwable: Child Error
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
      Caused by: java.lang.NullPointerException
      at org.apache.hadoop.mapred.JvmManager$JvmManagerForType.getDetails(JvmManager.java:402)
      at org.apache.hadoop.mapred.JvmManager$JvmManagerForType.reapJvm(JvmManager.java:387)
      at org.apache.hadoop.mapred.JvmManager$JvmManagerForType.access$000(JvmManager.java:192)
      at org.apache.hadoop.mapred.JvmManager.launchJvm(JvmManager.java:125)
      at org.apache.hadoop.mapred.TaskRunner.launchJvmAndWait(TaskRunner.java:292)
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:251)

      -------
      java.lang.Throwable: Child Error
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
      Caused by: java.lang.NullPointerException
      at org.apache.hadoop.mapred.JvmManager$JvmManagerForType.getDetails(JvmManager.java:402)
      at org.apache.hadoop.mapred.JvmManager$JvmManagerForType.reapJvm(JvmManager.java:387)
      at org.apache.hadoop.mapred.JvmManager$JvmManagerForType.access$000(JvmManager.java:192)
      at org.apache.hadoop.mapred.JvmManager.launchJvm(JvmManager.java:125)
      at org.apache.hadoop.mapred.TaskRunner.launchJvmAndWait(TaskRunner.java:292)
      at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:251)

      Attachments

        1. MAPREDUCE-5260-branch-1.1.patch
          2 kB
          yunjiong zhao

        Issue Links

          Activity

            People

              zhaoyunjiong yunjiong zhao
              zhaoyunjiong yunjiong zhao
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: