Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-436

NPE in TaskRunner.run if hadoop.log.dir not set

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      I'm getting an NPE in TaskRunner.run, looks like it happens when the system property hadoop.log.dir is unset

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Resolved Resolved
          1945d 12h 25m 1 Allen Wittenauer 18/Jul/14 05:16
          Allen Wittenauer made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Duplicate [ 3 ]
          Hide
          Allen Wittenauer added a comment -

          Closing as a dupe.

          Show
          Allen Wittenauer added a comment - Closing as a dupe.
          Steve Loughran made changes -
          Link This issue is duplicated by HADOOP-2681 [ HADOOP-2681 ]
          Gavin made changes -
          Reporter Steve Loughran [ steve_l ] Steve Loughran [ stevel@apache.org ]
          Steve Loughran made changes -
          Link This issue is related to HADOOP-2681 [ HADOOP-2681 ]
          Owen O'Malley made changes -
          Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
          Key HADOOP-5546 MAPREDUCE-436
          Affects Version/s 0.21.0 [ 12313563 ]
          Component/s mapred [ 12310690 ]
          Hide
          Steve Loughran added a comment -

          we see a similar stack trace in the JT too.

          Show
          Steve Loughran added a comment - we see a similar stack trace in the JT too.
          Steve Loughran made changes -
          Field Original Value New Value
          Link This issue relates to HADOOP-3438 [ HADOOP-3438 ]
          Hide
          Steve Loughran added a comment -

          Full tracelog. This shows the value in including detailed exception info in test run data; all this is being received and printed by the client

          
          org.smartfrog.test.TerminationRecordException: Test failed
          (unknown) -TestCompletedEvent at Fri Mar 20 16:50:23 GMT 2009 alive: true
          status:
          Termination Record: HOST annecy:rootProcess:testJobSubmission.sf:tests:job, type: abnormal, description: Job ID=job_200903201649_0001 has failed
          Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :1 failed: 1
          Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :1 failed: 1
          Reduce: Task Id : attempt_200903201649_0001_m_000001_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :2 failed: 2
          Submit a job to a cluster and copy out the result
          
          succeeded:false
          forcedTimeout:false
          skipped:false
          Termination Record: HOST annecy:rootProcess:testJobSubmission.sf:tests:job, type: abnormal, description: Job ID=job_200903201649_0001 has failed
          Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :1 failed: 1
          Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :1 failed: 1
          Reduce: Task Id : attempt_200903201649_0001_m_000001_0, Status : TIPFAILED
          java.lang.NullPointerException
          at java.io.File.(File.java:222)
          at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348)
          
          Tasks run :2 failed: 2
          at org.smartfrog.test.DeployingTestBase.completeTestDeployment(DeployingTestBase.java:315)
          at org.smartfrog.test.DeployingTestBase.runTestsToCompletion(DeployingTestBase.java:338)
          at org.smartfrog.test.DeployingTestBase.expectSuccessfulTestRunOrSkip(DeployingTestBase.java:439)
          at org.smartfrog.extras.hadoop.cluster.test.system.mapreduce.JobSubmissionTest.testJobSubmission(JobSubmissionTest.java:37)
          
          Show
          Steve Loughran added a comment - Full tracelog. This shows the value in including detailed exception info in test run data; all this is being received and printed by the client org.smartfrog.test.TerminationRecordException: Test failed (unknown) -TestCompletedEvent at Fri Mar 20 16:50:23 GMT 2009 alive: true status: Termination Record: HOST annecy:rootProcess:testJobSubmission.sf:tests:job, type: abnormal, description: Job ID=job_200903201649_0001 has failed Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :1 failed: 1 Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :1 failed: 1 Reduce: Task Id : attempt_200903201649_0001_m_000001_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :2 failed: 2 Submit a job to a cluster and copy out the result succeeded: false forcedTimeout: false skipped: false Termination Record: HOST annecy:rootProcess:testJobSubmission.sf:tests:job, type: abnormal, description: Job ID=job_200903201649_0001 has failed Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :1 failed: 1 Reduce: Task Id : attempt_200903201649_0001_m_000002_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :1 failed: 1 Reduce: Task Id : attempt_200903201649_0001_m_000001_0, Status : TIPFAILED java.lang.NullPointerException at java.io.File.(File.java:222) at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:348) Tasks run :2 failed: 2 at org.smartfrog.test.DeployingTestBase.completeTestDeployment(DeployingTestBase.java:315) at org.smartfrog.test.DeployingTestBase.runTestsToCompletion(DeployingTestBase.java:338) at org.smartfrog.test.DeployingTestBase.expectSuccessfulTestRunOrSkip(DeployingTestBase.java:439) at org.smartfrog.extras.hadoop.cluster.test.system.mapreduce.JobSubmissionTest.testJobSubmission(JobSubmissionTest.java:37)
          Steve Loughran created issue -

            People

            • Assignee:
              Unassigned
              Reporter:
              Steve Loughran
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development