Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3630

NullPointerException running teragen

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.23.0
    • 0.23.1
    • mrv2
    • None
    • Reviewed
    • Committed to trunk and branch-0.23. Thanks Mahadev.

    Description

      CMD = /grid/0/gs/gridre/yroot.omegab/share/hadoopcommon/bin/hadoop --config /grid/0/gs/gridre/yroot.omegab/conf/hadoop/
      jar /grid/0/gs/gridre/yroot.omegab/share/hadoopmapred/hadoop-mapreduce-examples-*.jar teragen
      -Dmapred.job.queue.name=audience -Dmapreduce.job.acl-view-job=* -Dyarn.app.mapreduce.am.staging-dir=/user
      -Dmapreduce.jobtracker.staging.root.dir=/user 1 teraInputDir

      Error:
      11/09/21 21:59:59 INFO mapreduce.Job: map 50% reduce 0%
      11/09/21 22:00:00 INFO mapreduce.Job: Task Id : attempt_1316132655177_0533_m_000001_0, Status : FAILED
      java.lang.NullPointerException
      at org.apache.hadoop.examples.terasort.TeraGen$SortGenMapper.cleanup(TeraGen.java:241)
      at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:708)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
      at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:148)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
      at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:143)

      11/09/21 22:00:00 WARN mapreduce.Job: Error reading task output Server returned HTTP response code: 400 for URL: http://.../tasklog?plaintext=true&attemptid=attempt_1316132655177_0533_m_000001_0&filter=stdout
      11/09/21 22:00:00 WARN mapreduce.Job: Error reading task output Server returned HTTP response code: 400 for URL: http://.../tasklog?plaintext=true&attemptid=attempt_1316132655177_0533_m_000001_0&filter=stderr

      Attachments

        1. MAPREDUCE-3630.patch
          1.0 kB
          Mahadev Konar

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mahadev Mahadev Konar
            amolkekre Amol Kekre
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment