Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4264

Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.3
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: mrv2
    • Labels:
      None

      Description

      Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.

      12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)

      Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"

        Activity

          People

          • Assignee:
            Thomas Graves
            Reporter:
            Thomas Graves
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development