Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9444

$var shell substitution in properties are not expanded in hadoop-policy.xml

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.0.1-alpha
    • 2.0.4-alpha
    • conf
    • None
    • BigTop Kerberized cluster test environment

    • Reviewed

    Description

      During BigTop 0.6.0 release test cycle, Roman Shaposhnik came around the following problem:

      013-03-26 15:37:03,573 FATAL
      org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting
      NodeManager
      org.apache.hadoop.yarn.YarnException: Failed to Start
      org.apache.hadoop.yarn.server.nodemanager.NodeManager
              at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
              at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:199)
              at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:322)
              at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:359)
      Caused by: org.apache.avro.AvroRuntimeException:
      java.lang.reflect.UndeclaredThrowableException
              at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:162)
              at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
              ... 3 more
      Caused by: java.lang.reflect.UndeclaredThrowableException
              at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:128)
              at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
              at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:199)
              at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:158)
              ... 4 more
      Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException):
      User yarn/ip-10-46-37-244.ec2.internal@BIGTOP (auth:KERBEROS) is not
      authorized for protocol interface
      org.apache.hadoop.yarn.server.api.ResourceTrackerPB, expected client
      Kerberos principal is yarn/ip-10-46-37-244.ec2.internal@BIGTOP
              at org.apache.hadoop.ipc.Client.call(Client.java:1235)
              at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
              at $Proxy26.registerNodeManager(Unknown Source)
              at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
              ... 6 more
      
      

      The most significant part is
      User yarn/ip-10-46-37-244.ec2.internal@BIGTOP (auth:KERBEROS) is not authorized for protocol interface org.apache.hadoop.yarn.server.api.ResourceTrackerPB indicating that ResourceTrackerPB hasn't been annotated with @KerberosInfo nor @TokenInfo

      Attachments

        1. YARN-509.patch.txt
          2 kB
          Roman Shaposhnik

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rvs Roman Shaposhnik
            cos Konstantin I Boudnik
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment