Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-436

NPE in TaskRunner.run if hadoop.log.dir not set

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      I'm getting an NPE in TaskRunner.run, looks like it happens when the system property hadoop.log.dir is unset

        Issue Links

          Activity

          Hide
          Steve Loughran added a comment -

          Full tracelog. This shows the value in including detailed exception info in test run data; all this is being received and printed by the client

          
          org.smartfrog.test.TerminationRecordException: Test failed
          (unknown) -TestCompletedEvent at Fri Mar 20 16:50:23 GMT 2009 alive: true
          status:
          Termination Record: HOST annecy:rootProcess:testJobSubmission.sf:tests:job, type: abnormal, description: Job ID=job_200903201649_0001 has failed
          Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :1 failed: 1
          Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :1 failed: 1
          Reduce: Task Id : attempt_200903201649_0001_m_000001_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :2 failed: 2
          Submit a job to a cluster and copy out the result
          
          succeeded:false
          forcedTimeout:false
          skipped:false
          Termination Record: HOST annecy:rootProcess:testJobSubmission.sf:tests:job, type: abnormal, description: Job ID=job_200903201649_0001 has failed
          Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :1 failed: 1
          Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :1 failed: 1
          Reduce: Task Id : attempt_200903201649_0001_m_000001_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :2 failed: 2
          at org.smartfrog.test.DeployingTestBase.completeTestDeployment(DeployingTestBase.java:315)
          at org.smartfrog.test.DeployingTestBase.runTestsToCompletion(DeployingTestBase.java:338)
          at org.smartfrog.test.DeployingTestBase.expectSuccessfulTestRunOrSkip(DeployingTestBase.java:439)
          at org.smartfrog.extras.hadoop.cluster.test.system.mapreduce.JobSubmissionTest.testJobSubmission(JobSubmissionTest.java:37)
          
          Show
          Steve Loughran added a comment - Full tracelog. This shows the value in including detailed exception info in test run data; all this is being received and printed by the client org.smartfrog.test.TerminationRecordException: Test failed (unknown) -TestCompletedEvent at Fri Mar 20 16:50:23 GMT 2009 alive: true status: Termination Record: HOST annecy:rootProcess:testJobSubmission.sf:tests:job, type: abnormal, description: Job ID=job_200903201649_0001 has failed Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :1 failed: 1 Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :1 failed: 1 Reduce: Task Id : attempt_200903201649_0001_m_000001_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :2 failed: 2 Submit a job to a cluster and copy out the result succeeded: false forcedTimeout: false skipped: false Termination Record: HOST annecy:rootProcess:testJobSubmission.sf:tests:job, type: abnormal, description: Job ID=job_200903201649_0001 has failed Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :1 failed: 1 Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :1 failed: 1 Reduce: Task Id : attempt_200903201649_0001_m_000001_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :2 failed: 2 at org.smartfrog.test.DeployingTestBase.completeTestDeployment(DeployingTestBase.java:315) at org.smartfrog.test.DeployingTestBase.runTestsToCompletion(DeployingTestBase.java:338) at org.smartfrog.test.DeployingTestBase.expectSuccessfulTestRunOrSkip(DeployingTestBase.java:439) at org.smartfrog.extras.hadoop.cluster.test.system.mapreduce.JobSubmissionTest.testJobSubmission(JobSubmissionTest.java:37)
          Hide
          Steve Loughran added a comment -

          we see a similar stack trace in the JT too.

          Show
          Steve Loughran added a comment - we see a similar stack trace in the JT too.
          Hide
          Allen Wittenauer added a comment -

          Closing as a dupe.

          Show
          Allen Wittenauer added a comment - Closing as a dupe.

            People

            • Assignee:
              Unassigned
              Reporter:
              Steve Loughran
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development