Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-4866

flink on yarn kerberos

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.9.0
    • None
    • flink

    Description

      flink:flink-1.10.0

      Zeppelin:zeppelin-0.9.0-preview1-bin-all

      hadoop  kerberos

      Setting the following parameters is invalid must be kinit:
      security.kerberos.login.keytab 
      security.kerberos.login.principal

       

      ERROR LOGS:

       org.apache.zeppelin.interpreter.InterpreterException: org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session cluster
      at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
      at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:668)
      at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:577)
      at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
      at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
      at org.apache.zeppelin.scheduler.ParallelScheduler.lambda$runJobInScheduler$0(ParallelScheduler.java:39)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)
      Caused by: org.apache.zeppelin.interpreter.InterpreterException: org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session cluster
      at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
      at org.apache.zeppelin.interpreter.Interpreter.getInterpreterInTheSameSessionByClassName(Interpreter.java:355)
      at org.apache.zeppelin.interpreter.Interpreter.getInterpreterInTheSameSessionByClassName(Interpreter.java:366)
      at org.apache.zeppelin.flink.FlinkSqlInterrpeter.open(FlinkSqlInterrpeter.java:109)
      at org.apache.zeppelin.flink.FlinkBatchSqlInterpreter.open(FlinkBatchSqlInterpreter.java:45)
      at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
      ... 8 more
      Caused by: org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session cluster
      at org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:380)
      at org.apache.flink.api.scala.FlinkShell$.deployNewYarnCluster(FlinkShell.scala:257)
      at org.apache.flink.api.scala.FlinkShell$.createYarnClusterIfNeededAndGetConfig(FlinkShell.scala:219)
      at org.apache.flink.api.scala.FlinkShell$.fetchConnectionInfo(FlinkShell.scala:208)
      at org.apache.zeppelin.flink.FlinkScalaInterpreter.open(FlinkScalaInterpreter.scala:203)
      at org.apache.zeppelin.flink.FlinkInterpreter.open(FlinkInterpreter.java:66)
      at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
      ... 13 more
      Caused by: java.lang.RuntimeException: Hadoop security with Kerberos is enabled but the login user does not have Kerberos credentials
      at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:439)
      at org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:373)
      ... 19 more

      Attachments

        Activity

          People

            Unassigned Unassigned
            wzxwf kevin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: