Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Invalid
-
2.3.0, 2.3.1
-
None
-
scala 2.11.8
java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)------------------------------------------------------------
Gradle 4.5.1
------------------------------------------------------------Build time: 2018-02-05 13:22:49 UTC
Revision: 37007e1c012001ff09973e0bd095139239ecd3b3Groovy: 2.4.12
Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017
JVM: 1.8.0_181 (Oracle Corporation 25.181-b13)
OS: Windows 7 6.1 amd64build.gradle:
group 'it.build-test.spark'
version '1.0-SNAPSHOT'apply plugin: 'java'
apply plugin: 'scala'sourceCompatibility = 1.8
repositories
{ mavenCentral() }dependencies
{ compile 'org.apache.spark:spark-core_2.11:2.3.1' compile 'org.scala-lang:scala-library:2.11.8' }tasks.withType(ScalaCompile)
{ scalaCompileOptions.additionalParameters = ["-Ylog-classpath"] }scala 2.11.8 java version "1.8.0_181" Java(TM) SE Runtime Environment (build 1.8.0_181-b13) Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode) ------------------------------------------------------------ Gradle 4.5.1 ------------------------------------------------------------ Build time: 2018-02-05 13:22:49 UTC Revision: 37007e1c012001ff09973e0bd095139239ecd3b3 Groovy: 2.4.12 Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 JVM: 1.8.0_181 (Oracle Corporation 25.181-b13) OS: Windows 7 6.1 amd64 build.gradle: group 'it.build-test.spark' version '1.0-SNAPSHOT' apply plugin: 'java' apply plugin: 'scala' sourceCompatibility = 1.8 repositories { mavenCentral() } dependencies { compile 'org.apache.spark:spark-core_2.11:2.3.1' compile 'org.scala-lang:scala-library:2.11.8' } tasks.withType(ScalaCompile) { scalaCompileOptions.additionalParameters = ["-Ylog-classpath"] }
Description
Hi. I'm trying to customize SparkUi with my business logic. Trying to access to ui, I have ta build problem. It's enough to create this class:
package org.apache.spark
import org.apache.spark.ui.SparkUI
case class SparkContextUtils(sc: SparkContext) {
def ui: Option[SparkUI] = sc.ui
}
to have this error:
missing or invalid dependency detected while loading class file 'WebUI.class'.
Could not access term eclipse in package org,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.
missing or invalid dependency detected while loading class file 'WebUI.class'.
Could not access term jetty in value org.eclipse,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.eclipse.
two errors found
:compileScala FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':compileScala'.
> Compilation failed
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
_* Get more help at https://help.gradle.org_
BUILD FAILED in 26s
1 actionable task: 1 executed
Compilation failed
The option "-Ylog-classpath" hasn't any useful information