Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3348

mapred job -status fails to give info even if the job is present in History

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app.

      Description

      It is trying to get the app report from the RM for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.

      11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
      11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
      RemoteTrace:
       at LocalTrace:
              org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
              at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
              at $Proxy6.getApplicationReport(Unknown Source)
              at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
              at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
              at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
              at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
              at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
              at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
              at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
              at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
              at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
      Exception in thread "main" RemoteTrace:
       at Local Trace:
              org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
              at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
              at $Proxy6.getApplicationReport(Unknown Source)
              at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
              at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
              at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
              at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
              at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
              at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
              at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
              at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
              at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
      
      
      1. MAPREDUCE-3348-1.patch
        6 kB
        Devaraj K
      2. MAPREDUCE-3348.patch
        4 kB
        Devaraj K

        Activity

        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Arun C Murthy made changes -
        Fix Version/s 2.0.2-alpha [ 12322471 ]
        Robert Joseph Evans made changes -
        Fix Version/s 0.23.3 [ 12320060 ]
        Fix Version/s 0.23.2 [ 12319851 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Release Note Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app.
        Resolution Fixed [ 1 ]
        Devaraj K made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj K made changes -
        Attachment MAPREDUCE-3348-1.patch [ 12517690 ]
        Vinod Kumar Vavilapalli made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Affects Version/s 0.23.0 [ 12315570 ]
        Affects Version/s 0.24.0 [ 12317654 ]
        Fix Version/s 0.23.2 [ 12319851 ]
        Devaraj K made changes -
        Component/s mrv2 [ 12314301 ]
        Devaraj K made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj K made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-3348.patch [ 12514501 ]
        Devaraj K created issue -

          People

          • Assignee:
            Devaraj K
            Reporter:
            Devaraj K
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development