Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3348

mapred job -status fails to give info even if the job is present in History

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.23.3, 2.0.2-alpha
    • mrv2
    • None
    • Reviewed
    • Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app.

    Description

      It is trying to get the app report from the RM for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.

      11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
      11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
      RemoteTrace:
       at LocalTrace:
              org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
              at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
              at $Proxy6.getApplicationReport(Unknown Source)
              at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
              at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
              at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
              at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
              at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
              at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
              at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
              at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
              at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
      Exception in thread "main" RemoteTrace:
       at Local Trace:
              org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
              at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
              at $Proxy6.getApplicationReport(Unknown Source)
              at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
              at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
              at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
              at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
              at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
              at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
              at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
              at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
              at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
      
      

      Attachments

        1. MAPREDUCE-3348.patch
          4 kB
          Devaraj Kavali
        2. MAPREDUCE-3348-1.patch
          6 kB
          Devaraj Kavali

        Activity

          People

            devaraj Devaraj Kavali
            devaraj Devaraj Kavali
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: