Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6554

MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 2.8.0, 2.7.3, 2.6.4, 3.0.0-alpha1
    • None
    • None
    • Reviewed

    Description

      Create scenario so that MR app master gets preempted.
      On next MRAppMaster launch tried to recover previous job history file MRAppMaster#parsePreviousJobHistory

      2015-11-21 13:52:27,722 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; cause: java.lang.NullPointerException
      java.lang.NullPointerException
              at java.io.StringReader.<init>(StringReader.java:50)
              at org.apache.avro.Schema$Parser.parse(Schema.java:917)
              at org.apache.avro.Schema.parse(Schema.java:966)
              at org.apache.hadoop.mapreduce.jobhistory.EventReader.<init>(EventReader.java:75)
              at org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087)
              at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:422)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499)
      2015-11-21 13:52:27,725 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
      
      

      EventReader(EventReader stream)

       this.version = in.readLine();
      ...
          Schema myschema = new SpecificData(Event.class.getClassLoader()).getSchema(Event.class);
          this.schema = Schema.parse(in.readLine());
      

      Attachments

        1. MAPREDUCE-6554-branch-2.7.001.patch
          3 kB
          Bibin Chundatt
        2. MAPREDUCE-6554-branch-2.7.patch
          3 kB
          Bibin Chundatt
        3. 0003-MAPREDUCE-6554.patch
          3 kB
          Bibin Chundatt
        4. 0002-MAPREDUCE-6554.patch
          2 kB
          Bibin Chundatt
        5. 0001-MAPREDUCE-6554.patch
          3 kB
          Bibin Chundatt

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            bibinchundatt Bibin Chundatt
            bibinchundatt Bibin Chundatt
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment