[ZEPPELIN-5881] can't compile spark 3.3

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Assignee: Phong Nguyen
• Reporter: comet
• Created: 11/Feb/23 13:50
• Updated: 01/Mar/23 16:41
• Resolved: 01/Mar/23 16:41

Description

on the master branch, when i build zeppelin/Dockerfile with

 

./mvnw -B package -DskipTests -Pbuild-distr -Pspark-3.3 -Pinclude-hadoop -Phadoop3 -Pspark-scala-2.12 -Pweb-angular -Pweb-dist

 

i get error

 

[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[687,11] cannot find symbol
[ERROR]   symbol:   class AuthenticationToken
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[688,14] cannot find symbol
[INFO] Zeppelin: Markdown interpreter ..................... SUCCESS [  4.732 s]                                                                                                                    [89/1957]
[INFO] Zeppelin: MongoDB interpreter ...................... SUCCESS [  0.518 s]
[INFO] Zeppelin: Angular interpreter ...................... SUCCESS [  0.373 s]
[INFO] Zeppelin: Livy interpreter ......................... SUCCESS [ 53.694 s]
[INFO] Zeppelin: HBase interpreter ........................ SUCCESS [ 36.755 s]
[INFO] Zeppelin: JDBC interpreter ......................... SUCCESS [02:19 min]
[INFO] Zeppelin: File System Interpreters ................. SUCCESS [  1.858 s]
[INFO] Zeppelin: Flink Parent ............................. SUCCESS [  0.157 s]
[INFO] Zeppelin: Flink Shims .............................. SUCCESS [  1.803 s]
[INFO] Zeppelin: Flink1.13 Shims .......................... SUCCESS [01:05 min]
[INFO] Zeppelin: Flink1.14 Shims .......................... SUCCESS [ 53.029 s]
[INFO] Zeppelin: Flink1.15 Shims .......................... SUCCESS [01:02 min]
[INFO] Zeppelin: Flink1.16 Shims .......................... SUCCESS [ 38.489 s]
[INFO] Zeppelin: Flink Scala Parent ....................... SUCCESS [01:16 min]
[INFO] Zeppelin: Flink-Cmd interpreter .................... SUCCESS [  2.965 s]
[INFO] Zeppelin: InfluxDB interpreter ..................... SUCCESS [ 14.294 s]
[INFO] Zeppelin: Apache Cassandra interpreter ............. SUCCESS [01:25 min]
[INFO] Zeppelin: Elasticsearch interpreter ................ SUCCESS [ 21.956 s]
[INFO] Zeppelin: BigQuery interpreter ..................... SUCCESS [03:13 min]
[INFO] Zeppelin: Alluxio interpreter ...................... SUCCESS [02:29 min]
[INFO] Zeppelin: Neo4j interpreter ........................ SUCCESS [ 12.282 s]
[INFO] Zeppelin: Java interpreter ......................... SUCCESS [  1.133 s]
[INFO] Zeppelin: Sparql interpreter ....................... SUCCESS [ 21.923 s]
[INFO] Zeppelin: Client ................................... SUCCESS [  3.399 s]
[INFO] Zeppelin: Client Examples .......................... SUCCESS [  0.167 s]
[INFO] Zeppelin: Server ................................... FAILURE [ 38.227 s]
[INFO] Zeppelin: web Application .......................... SKIPPED
[INFO] Zeppelin: Plugins Parent ........................... SKIPPED
[INFO] Zeppelin: Plugin S3NotebookRepo .................... SKIPPED
[INFO] Zeppelin: Plugin GitHubNotebookRepo ................ SKIPPED
[INFO] Zeppelin: Plugin AzureNotebookRepo ................. SKIPPED
[INFO] Zeppelin: Plugin OSSNotebookRepo ................... SKIPPED                                                                                                                                [55/1957]
[INFO] Zeppelin: Plugin Kubernetes StandardLauncher ....... SKIPPED
[INFO] Zeppelin: Plugin Flink Launcher .................... SKIPPED
[INFO] Zeppelin: Plugin Docker Launcher ................... SKIPPED
[INFO] Zeppelin: Plugin Cluster Launcher .................. SKIPPED
[INFO] Zeppelin: Plugin Yarn Launcher ..................... SKIPPED
[INFO] Zeppelin: web angular Application .................. SKIPPED
[INFO] Zeppelin: Packaging distribution ................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  55:42 min
[INFO] Finished at: 2023-02-10T11:18:45Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.10.1:compile (default-compile) on project zeppelin-server: Compilation failure: Compilation failure:
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosAuthenticationFilter.java:[19,56] package org.apache.hadoop.security.authentication.server does not exi
st
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[20,30] package org.apache.hadoop.conf does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[21,34] package org.apache.hadoop.security does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[22,56] package org.apache.hadoop.security.authentication.client does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[23,56] package org.apache.hadoop.security.authentication.client does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[24,56] package org.apache.hadoop.security.authentication.client does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[25,56] package org.apache.hadoop.security.authentication.server does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[26,56] package org.apache.hadoop.security.authentication.server does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[28,1] package org.apache.hadoop.security.authentication.util does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/jwt/KnoxJwtRealm.java:[23,30] package org.apache.hadoop.conf does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/jwt/KnoxJwtRealm.java:[24,34] package org.apache.hadoop.security does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[184,18] cannot find symbol
[ERROR]   symbol:   class Signer
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[185,11] cannot find symbol
[ERROR]   symbol:   class SignerSecretProvider
[ERROR]   symbol:   class AuthenticationException                                                                                                                                                   [0/1957]
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[695,18] cannot find symbol
[ERROR]   symbol:   class AuthenticationToken
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[696,14] cannot find symbol
[ERROR]   symbol:   class AuthenticationException
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[787,44] cannot find symbol
[ERROR]   symbol:   class AuthenticationToken
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/jwt/KnoxJwtRealm.java:[73,11] cannot find symbol
[ERROR]   symbol:   class Groups
[ERROR]   location: class org.apache.zeppelin.realm.jwt.KnoxJwtRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/LdapRealm.java:[47,30] package org.apache.hadoop.conf does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/LdapRealm.java:[48,40] package org.apache.hadoop.security.alias does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/LdapRealm.java:[49,40] package org.apache.hadoop.security.alias does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosUtil.java:[20,37] package org.apache.hadoop.util does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosUtil.java:[20,1] static import only from classes and interfaces
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :zeppelin-server
The command '/bin/sh -c echo "unsafe-perm=true" > ~/.npmrc &&     echo '{ "allow_root": true }' > ~/.bowerrc &&     ./mvnw -B package -DskipTests -Pbuild-distr -Pspark-3.3 -Pinclude-hadoop -Phadoop3 -Pspa
rk-scala-2.12 Pweb-angular -Pweb-dist &&     mv /workspace/zeppelin/zeppelin-distribution/target/zeppelin/zeppelin- /opt/zeppelin/ &&     rm -rf ~/.m2 &&     rm -rf /workspace/zeppelin/*' returned a n
on-zero code: 1
Copy Snippet
Edit Snippet
 Wordwrap
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[687,11] cannot find symbol
[ERROR]   symbol:   class AuthenticationToken
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[688,14] cannot find symbol
[INFO] Zeppelin: Markdown interpreter ..................... SUCCESS [  4.732 s]                                                                                                                    [89/1957]
[INFO] Zeppelin: MongoDB interpreter ...................... SUCCESS [  0.518 s]
[INFO] Zeppelin: Angular interpreter ...................... SUCCESS [  0.373 s]
[INFO] Zeppelin: Livy interpreter ......................... SUCCESS [ 53.694 s]
[INFO] Zeppelin: HBase interpreter ........................ SUCCESS [ 36.755 s]
[INFO] Zeppelin: JDBC interpreter ......................... SUCCESS [02:19 min]
[INFO] Zeppelin: File System Interpreters ................. SUCCESS [  1.858 s]
[INFO] Zeppelin: Flink Parent ............................. SUCCESS [  0.157 s]
[INFO] Zeppelin: Flink Shims .............................. SUCCESS [  1.803 s]
[INFO] Zeppelin: Flink1.13 Shims .......................... SUCCESS [01:05 min]
[INFO] Zeppelin: Flink1.14 Shims .......................... SUCCESS [ 53.029 s]
[INFO] Zeppelin: Flink1.15 Shims .......................... SUCCESS [01:02 min]
[INFO] Zeppelin: Flink1.16 Shims .......................... SUCCESS [ 38.489 s]
[INFO] Zeppelin: Flink Scala Parent ....................... SUCCESS [01:16 min]
[INFO] Zeppelin: Flink-Cmd interpreter .................... SUCCESS [  2.965 s]
[INFO] Zeppelin: InfluxDB interpreter ..................... SUCCESS [ 14.294 s]
[INFO] Zeppelin: Apache Cassandra interpreter ............. SUCCESS [01:25 min]
[INFO] Zeppelin: Elasticsearch interpreter ................ SUCCESS [ 21.956 s]
[INFO] Zeppelin: BigQuery interpreter ..................... SUCCESS [03:13 min]
[INFO] Zeppelin: Alluxio interpreter ...................... SUCCESS [02:29 min]
[INFO] Zeppelin: Neo4j interpreter ........................ SUCCESS [ 12.282 s]
[INFO] Zeppelin: Java interpreter ......................... SUCCESS [  1.133 s]
[INFO] Zeppelin: Sparql interpreter ....................... SUCCESS [ 21.923 s]
[INFO] Zeppelin: Client ................................... SUCCESS [  3.399 s]
[INFO] Zeppelin: Client Examples .......................... SUCCESS [  0.167 s]
[INFO] Zeppelin: Server ................................... FAILURE [ 38.227 s]
[INFO] Zeppelin: web Application .......................... SKIPPED
[INFO] Zeppelin: Plugins Parent ........................... SKIPPED
[INFO] Zeppelin: Plugin S3NotebookRepo .................... SKIPPED
[INFO] Zeppelin: Plugin GitHubNotebookRepo ................ SKIPPED
[INFO] Zeppelin: Plugin AzureNotebookRepo ................. SKIPPED
[INFO] Zeppelin: Plugin OSSNotebookRepo ................... SKIPPED                                                                                                                                [55/1957]
[INFO] Zeppelin: Plugin Kubernetes StandardLauncher ....... SKIPPED
[INFO] Zeppelin: Plugin Flink Launcher .................... SKIPPED
[INFO] Zeppelin: Plugin Docker Launcher ................... SKIPPED
[INFO] Zeppelin: Plugin Cluster Launcher .................. SKIPPED
[INFO] Zeppelin: Plugin Yarn Launcher ..................... SKIPPED
[INFO] Zeppelin: web angular Application .................. SKIPPED
[INFO] Zeppelin: Packaging distribution ................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  55:42 min
[INFO] Finished at: 2023-02-10T11:18:45Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.10.1:compile (default-compile) on project zeppelin-server: Compilation failure: Compilation failure:
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosAuthenticationFilter.java:[19,56] package org.apache.hadoop.security.authentication.server does not exi
st
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[20,30] package org.apache.hadoop.conf does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[21,34] package org.apache.hadoop.security does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[22,56] package org.apache.hadoop.security.authentication.client does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[23,56] package org.apache.hadoop.security.authentication.client does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[24,56] package org.apache.hadoop.security.authentication.client does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[25,56] package org.apache.hadoop.security.authentication.server does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[26,56] package org.apache.hadoop.security.authentication.server does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[28,1] package org.apache.hadoop.security.authentication.util does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/jwt/KnoxJwtRealm.java:[23,30] package org.apache.hadoop.conf does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/jwt/KnoxJwtRealm.java:[24,34] package org.apache.hadoop.security does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[184,18] cannot find symbol
[ERROR]   symbol:   class Signer
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[185,11] cannot find symbol
[ERROR]   symbol:   class SignerSecretProvider
[ERROR]   symbol:   class AuthenticationException                                                                                                                                                   [0/1957]
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[695,18] cannot find symbol
[ERROR]   symbol:   class AuthenticationToken
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[696,14] cannot find symbol
[ERROR]   symbol:   class AuthenticationException
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosRealm.java:[787,44] cannot find symbol
[ERROR]   symbol:   class AuthenticationToken
[ERROR]   location: class org.apache.zeppelin.realm.kerberos.KerberosRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/jwt/KnoxJwtRealm.java:[73,11] cannot find symbol
[ERROR]   symbol:   class Groups
[ERROR]   location: class org.apache.zeppelin.realm.jwt.KnoxJwtRealm
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/LdapRealm.java:[47,30] package org.apache.hadoop.conf does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/LdapRealm.java:[48,40] package org.apache.hadoop.security.alias does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/LdapRealm.java:[49,40] package org.apache.hadoop.security.alias does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosUtil.java:[20,37] package org.apache.hadoop.util does not exist
[ERROR] /workspace/zeppelin/zeppelin-server/src/main/java/org/apache/zeppelin/realm/kerberos/KerberosUtil.java:[20,1] static import only from classes and interfaces
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :zeppelin-server
The command '/bin/sh -c echo "unsafe-perm=true" > ~/.npmrc &&     echo '{ "allow_root": true }' > ~/.bowerrc &&     ./mvnw -B package -DskipTests -Pbuild-distr -Pspark-3.3 -Pinclude-hadoop -Phadoop3 -Pspa
rk-scala-2.12 Pweb-angular -Pweb-dist &&     mv /workspace/zeppelin/zeppelin-distribution/target/zeppelin/zeppelin- /opt/zeppelin/ &&     rm -rf ~/.m2 &&     rm -rf /workspace/zeppelin/*' returned a n
on-zero code: 1

Issue Links

• links to: GitHub Pull Request #4570