[SPARK-24944] SparkUi build problem

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 2.3.0, 2.3.1
• Component/s: Build
• Labels: UI WebUI build

Environment

scala 2.11.8

java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)

------------------------------------------------------------
Gradle 4.5.1
------------------------------------------------------------

Build time: 2018-02-05 13:22:49 UTC
Revision: 37007e1c012001ff09973e0bd095139239ecd3b3

Groovy: 2.4.12
Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017
JVM: 1.8.0_181 (Oracle Corporation 25.181-b13)
OS: Windows 7 6.1 amd64

 

build.gradle:

group 'it.build-test.spark'
version '1.0-SNAPSHOT'

apply plugin: 'java'
apply plugin: 'scala'

sourceCompatibility = 1.8

repositories

{ mavenCentral() }

dependencies

{ compile 'org.apache.spark:spark-core_2.11:2.3.1' compile 'org.scala-lang:scala-library:2.11.8' }

tasks.withType(ScalaCompile)

{ scalaCompileOptions.additionalParameters = ["-Ylog-classpath"] }

• Assignee: Unassigned
• Reporter: Fabio
• Created: 27/Jul/18 13:18
• Updated: 30/Jul/18 07:59
• Resolved: 30/Jul/18 07:59

Description

Hi. I'm trying to customize SparkUi with my business logic. Trying to access to ui, I have ta build problem. It's enough to create this class:

package org.apache.spark

import org.apache.spark.ui.SparkUI

case class SparkContextUtils(sc: SparkContext) {
def ui: Option[SparkUI] = sc.ui
}

 

to have this error:

 

missing or invalid dependency detected while loading class file 'WebUI.class'.
Could not access term eclipse in package org,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.
missing or invalid dependency detected while loading class file 'WebUI.class'.
Could not access term jetty in value org.eclipse,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.eclipse.
two errors found
:compileScala FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':compileScala'.
> Compilation failed

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

_* Get more help at https://help.gradle.org_

BUILD FAILED in 26s
1 actionable task: 1 executed
Compilation failed

 

The option "-Ylog-classpath" hasn't any useful information