[SPARK-3647] Shaded Guava patch causes access issues with package private classes

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.2.0
• Component/s: Spark Core
• Target Version/s: 1.2.0
• Assignee: Marcelo Masiero Vanzin Assign to me
• Reporter: Marcelo Masiero Vanzin
• Created: 22/Sep/14 20:50
• Updated: 11/Nov/14 08:11
• Resolved: 23/Sep/14 20:42

Description

The patch that introduced shading to Guava (SPARK-2848) tried to maintain backwards compatibility in the Java API by not relocating the "Optional" class. That causes problems when that class references package private members in the Absent and Present classes, which are now in a different package:

Exception in thread "main" java.lang.IllegalAccessError: tried to access class org.spark-project.guava.common.base.Present from class com.google.common.base.Optional
	at com.google.common.base.Optional.of(Optional.java:86)
	at org.apache.spark.api.java.JavaUtils$.optionToOptional(JavaUtils.scala:25)
	at org.apache.spark.api.java.JavaSparkContext.getSparkHome(JavaSparkContext.scala:542)

Issue Links

• links to: [Github] Pull Request #2496 (vanzin)