Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6554

MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 2.7.3, 2.6.4, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Create scenario so that MR app master gets preempted.
      On next MRAppMaster launch tried to recover previous job history file MRAppMaster#parsePreviousJobHistory

      2015-11-21 13:52:27,722 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state STARTED; cause: java.lang.NullPointerException
      java.lang.NullPointerException
              at java.io.StringReader.<init>(StringReader.java:50)
              at org.apache.avro.Schema$Parser.parse(Schema.java:917)
              at org.apache.avro.Schema.parse(Schema.java:966)
              at org.apache.hadoop.mapreduce.jobhistory.EventReader.<init>(EventReader.java:75)
              at org.apache.hadoop.mapreduce.jobhistory.JobHistoryParser.parse(JobHistoryParser.java:139)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.parsePreviousJobHistory(MRAppMaster.java:1256)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.processRecovery(MRAppMaster.java:1225)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1087)
              at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1570)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:422)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1673)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1566)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1499)
      2015-11-21 13:52:27,725 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
      
      

      EventReader(EventReader stream)

       this.version = in.readLine();
      ...
          Schema myschema = new SpecificData(Event.class.getClassLoader()).getSchema(Event.class);
          this.schema = Schema.parse(in.readLine());
      

        Attachments

        1. MAPREDUCE-6554-branch-2.7.001.patch
          3 kB
          Bibin A Chundatt
        2. MAPREDUCE-6554-branch-2.7.patch
          3 kB
          Bibin A Chundatt
        3. 0003-MAPREDUCE-6554.patch
          3 kB
          Bibin A Chundatt
        4. 0002-MAPREDUCE-6554.patch
          2 kB
          Bibin A Chundatt
        5. 0001-MAPREDUCE-6554.patch
          3 kB
          Bibin A Chundatt

          Activity

            People

            • Assignee:
              bibinchundatt Bibin A Chundatt
              Reporter:
              bibinchundatt Bibin A Chundatt
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: