Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24944

SparkUi build problem

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Invalid
    • Affects Version/s: 2.3.0, 2.3.1
    • Fix Version/s: None
    • Component/s: Build
    • Labels:
    • Environment:

      Description

      Hi. I'm trying to customize SparkUi with my business logic. Trying to access to ui, I have ta build problem. It's enough to create this class:

      package org.apache.spark

      import org.apache.spark.ui.SparkUI

      case class SparkContextUtils(sc: SparkContext) {
      def ui: Option[SparkUI] = sc.ui
      }

       

      to have this error:

       

      missing or invalid dependency detected while loading class file 'WebUI.class'.
      Could not access term eclipse in package org,
      because it (or its dependencies) are missing. Check your build definition for
      missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
      A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.
      missing or invalid dependency detected while loading class file 'WebUI.class'.
      Could not access term jetty in value org.eclipse,
      because it (or its dependencies) are missing. Check your build definition for
      missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
      A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.eclipse.
      two errors found
      :compileScala FAILED

      FAILURE: Build failed with an exception.

      * What went wrong:
      Execution failed for task ':compileScala'.
      > Compilation failed

      * Try:
      Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

      _* Get more help at https://help.gradle.org_

      BUILD FAILED in 26s
      1 actionable task: 1 executed
      Compilation failed

       

      The option "-Ylog-classpath" hasn't any useful information

       

       

        Attachments

        1. build-test.zip
          2 kB
          Fabio

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Lardizzone Fabio
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: