Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4691

Historyserver can report "Unknown job" after RM says job has completed

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 2.0.1-alpha
    • Fix Version/s: 2.0.2-alpha, 0.23.4
    • Component/s: jobhistoryserver, mrv2
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Example traceback from the client:

      2012-09-27 20:28:38,068 [main] INFO  org.apache.hadoop.mapred.ClientServiceDelegate - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
      2012-09-27 20:28:38,530 [main] WARN  org.apache.hadoop.mapred.ClientServiceDelegate - Error from remote end: Unknown job job_1348097917603_3019
      2012-09-27 20:28:38,530 [main] ERROR org.apache.hadoop.security.UserGroupInformation - PriviledgedActionException as:xxx (auth:KERBEROS) cause:org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Unknown job job_1348097917603_3019
      2012-09-27 20:28:38,531 [main] WARN  org.apache.pig.tools.pigstats.JobStats - Failed to get map task report
      RemoteTrace: 
       at LocalTrace: 
              org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Unknown job job_1348097917603_3019
              at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:156)
              at $Proxy11.getJobReport(Unknown Source)
              at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getJobReport(MRClientProtocolPBClientImpl.java:116)
              at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
              at java.lang.reflect.Method.invoke(Method.java:597)
              at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:298)
              at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:383)
              at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:482)
              at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:184)
      ...
      
      1. MR-4691.txt
        4 kB
        Robert Joseph Evans

        Activity

        Allen Wittenauer made changes -
        Fix Version/s 3.0.0 [ 12320355 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Arun C Murthy made changes -
        Fix Version/s 2.0.2-alpha [ 12322471 ]
        Fix Version/s 2.0.3-alpha [ 12323275 ]
        Jason Lowe made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 3.0.0 [ 12320355 ]
        Fix Version/s 0.23.4 [ 12323264 ]
        Fix Version/s 2.0.3-alpha [ 12323275 ]
        Resolution Fixed [ 1 ]
        Robert Joseph Evans made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Target Version/s 0.23.4 [ 12323264 ]
        Robert Joseph Evans made changes -
        Attachment MR-4691.txt [ 12547008 ]
        Robert Joseph Evans made changes -
        Assignee Robert Joseph Evans [ revans2 ]
        Jason Lowe made changes -
        Field Original Value New Value
        Summary Historyserver can report "Unknown job" after RM says job has completed. Historyserver can report "Unknown job" after RM says job has completed
        Jason Lowe created issue -

          People

          • Assignee:
            Robert Joseph Evans
            Reporter:
            Jason Lowe
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development