[SPARK-18162] SparkEnv.get.metricsSystem in spark-shell results in error: missing or invalid dependency detected while loading class file 'MetricsSystem.class'

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Not A Problem
• Affects Version/s: 2.1.0
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Jacek Laskowski
• Created: 28/Oct/16 08:42
• Updated: 21/Oct/18 05:57
• Resolved: 30/Oct/16 08:21

Description

This is with the build today from master.

$ ./bin/spark-shell --version
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.1.0-SNAPSHOT
      /_/

Using Scala version 2.11.8, Java HotSpot(TM) 64-Bit Server VM, 1.8.0_102
Branch master
Compiled by user jacek on 2016-10-28T04:05:11Z
Revision ab5f938bc7c3c9b137d63e479fced2b7e9c9d75b
Url https://github.com/apache/spark.git
Type --help for more information.

$ ./bin/spark-shell

scala> SparkEnv.get.metricsSystem
error: missing or invalid dependency detected while loading class file 'MetricsSystem.class'.
Could not access term eclipse in package org,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'MetricsSystem.class' was compiled against an incompatible version of org.
error: missing or invalid dependency detected while loading class file 'MetricsSystem.class'.
Could not access term jetty in value org.eclipse,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'MetricsSystem.class' was compiled against an incompatible version of org.eclipse.

scala> spark.version
res3: String = 2.1.0-SNAPSHOT

I could not find any information about how to set it up in the official documentation.

Issue Links

• is related to: SPARK-24808 Unable to get the SparkEnv.get.metricsSystem on Spark Shell