Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4160

some mrv1 ant tests fail with timeout - due to 4156

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.3
    • 0.23.3, 2.0.2-alpha
    • test
    • None

    Description

      Looks like the old mrv1 history server is getting null error when trying to parse the a null for the TaskFinishedEvent successfulAttemptId which was added in jira 4156. This is causing the ant tests to take like 9 hours to run.

      [junit] java.io.IOException: java.lang.NullPointerException: null of string in field successfulAttemptId of org.apache.hadoop.mapreduce.jobhistory.TaskFinished of union in field event of org.apache.hadoop.mapreduce.jobhistory.Event
      [junit] at org.apache.avro.generic.GenericDatumWriter.npe(GenericDatumWriter.java:92)
      [junit] at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:86)
      [junit] at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:57)
      [junit] at org.apache.hadoop.mapreduce.jobhistory.EventWriter.write(EventWriter.java:66)
      [junit] at org.apache.hadoop.mapreduce.jobhistory.JobHistory$MetaInfo.writeEvent(JobHistory.java:512)
      [junit] at org.apache.hadoop.mapreduce.jobhistory.JobHistory.logEvent(JobHistory.java:345)
      [junit] at org.apache.hadoop.mapred.JobInProgress.completedTask(JobInProgress.java:2717)
      [junit] at org.apache.hadoop.mapred.JobInProgress.updateTaskStatus(JobInProgress.java:1221)

      Attachments

        1. MAPREDUCE-4160.patch
          0.7 kB
          Thomas Graves

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tgraves Thomas Graves
            tgraves Thomas Graves
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment