Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-4866

flink on yarn kerberos

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: None
    • Component/s: flink
    • Labels:

      Description

      flink:flink-1.10.0

      Zeppelin:zeppelin-0.9.0-preview1-bin-all

      hadoop  kerberos

      Setting the following parameters is invalid must be kinit:
      security.kerberos.login.keytab 
      security.kerberos.login.principal

       

      ERROR LOGS:

       org.apache.zeppelin.interpreter.InterpreterException: org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session cluster
      at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
      at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:668)
      at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:577)
      at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
      at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
      at org.apache.zeppelin.scheduler.ParallelScheduler.lambda$runJobInScheduler$0(ParallelScheduler.java:39)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)
      Caused by: org.apache.zeppelin.interpreter.InterpreterException: org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session cluster
      at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
      at org.apache.zeppelin.interpreter.Interpreter.getInterpreterInTheSameSessionByClassName(Interpreter.java:355)
      at org.apache.zeppelin.interpreter.Interpreter.getInterpreterInTheSameSessionByClassName(Interpreter.java:366)
      at org.apache.zeppelin.flink.FlinkSqlInterrpeter.open(FlinkSqlInterrpeter.java:109)
      at org.apache.zeppelin.flink.FlinkBatchSqlInterpreter.open(FlinkBatchSqlInterpreter.java:45)
      at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
      ... 8 more
      Caused by: org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session cluster
      at org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:380)
      at org.apache.flink.api.scala.FlinkShell$.deployNewYarnCluster(FlinkShell.scala:257)
      at org.apache.flink.api.scala.FlinkShell$.createYarnClusterIfNeededAndGetConfig(FlinkShell.scala:219)
      at org.apache.flink.api.scala.FlinkShell$.fetchConnectionInfo(FlinkShell.scala:208)
      at org.apache.zeppelin.flink.FlinkScalaInterpreter.open(FlinkScalaInterpreter.scala:203)
      at org.apache.zeppelin.flink.FlinkInterpreter.open(FlinkInterpreter.java:66)
      at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
      ... 13 more
      Caused by: java.lang.RuntimeException: Hadoop security with Kerberos is enabled but the login user does not have Kerberos credentials
      at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:439)
      at org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:373)
      ... 19 more

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              wzxwf kevin
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: