[ZEPPELIN-5344] I can't use tispark of tidb with kerberos in CDH

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Component/s: spark
• Assignee: Unassigned
• Reporter: ighack
• Created: 28/Apr/21 07:28
• Updated: 21/May/21 07:59
• Resolved: 17/May/21 07:56

Description

I modify spark.jars in interpreters

spark.jars

hdfs://bigdser1:8020/sparklib/*

 

run Spark SQL (Scala)-->Visualize DataFrame/Dataset via z.show

I get a error 

java.io.IOException: Failed on local exception: java.io.IOException: org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS]; Host Details : local host is: "bigdser4/10.3.87.26"; destination host is: "bigdser1":8020;

 

but I can run 

spark-submit --master yarn --deploy-mode cluster --principal jzyc/[e-mail] --keytab /hadoop/jzyc.keytab --class App --jars hdfs://bigdser1:8020/sparklib/* JZTanalyse-1.0-SNAPSHOT.jar 127.0.0.1 1 1 key

 

in "hdfs://bigdser1:8020/sparklib/*" only has tispark-assembly-2.3.14.jar

tispark