[SPARK-24808] Unable to get the SparkEnv.get.metricsSystem on Spark Shell

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.3.1
• Component/s: Spark Core, Spark Shell
• Labels: Spark bulk-closed metrics

Environment

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_144)

• Assignee: Unassigned
• Reporter: Praneeth Ramesh
• Created: 15/Jul/18 01:17
• Updated: 25/May/21 01:53
• Resolved: 25/May/21 01:39

Description

Open a Spark Shell in local or on Stand alone Cluster

 

scala> import org.apache.spark.SparkEnv
import org.apache.spark.SparkEnv

scala> SparkEnv.get.metricsSystem
error: missing or invalid dependency detected while loading class file 'MetricsSystem.class'.
Could not access term eclipse in package org,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'MetricsSystem.class' was compiled against an incompatible version of org.
error: missing or invalid dependency detected while loading class file 'MetricsSystem.class'.
Could not access term jetty in value org.eclipse,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'MetricsSystem.class' was compiled against an incompatible version of org.eclipse.

Issue Links

• relates to: SPARK-18162 SparkEnv.get.metricsSystem in spark-shell results in error: missing or invalid dependency detected while loading class file 'MetricsSystem.class'