Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4950

MR App Master fails to write the history due to AvroTypeException

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • jobhistoryserver, mr-am
    • None

    Description

      2013-01-19 19:31:27,269 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event MAP_ATTEMPT_STARTED
      2013-01-19 19:31:27,269 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.service.CompositeService: Error stopping JobHistoryEventHandler
      org.apache.avro.AvroTypeException: Attempt to process a enum when a array-start was expected.
      	at org.apache.avro.io.parsing.Parser.advance(Parser.java:93)
      	at org.apache.avro.io.JsonEncoder.writeEnum(JsonEncoder.java:210)
      	at org.apache.avro.specific.SpecificDatumWriter.writeEnum(SpecificDatumWriter.java:54)
      	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:66)
      	at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:104)
      	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:65)
      	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:57)
      	at org.apache.hadoop.mapreduce.jobhistory.EventWriter.write(EventWriter.java:66)
      	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler$MetaInfo.writeEvent(JobHistoryEventHandler.java:825)
      	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.handleEvent(JobHistoryEventHandler.java:517)
      	at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.stop(JobHistoryEventHandler.java:346)
      	at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:99)
      	at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
      	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:445)
      	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler.handle(MRAppMaster.java:406)
      	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:126)
      	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:75)
      	at java.lang.Thread.run(Thread.java:662)
      2013-01-19 19:31:27,271 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://hacluster /root/staging-dir/root/.staging/job_1358603069474_0135
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            devaraj Devaraj Kavali
            Votes:
            2 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated: