[SPARK-2848] Shade Guava in Spark deliverables

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: Spark Core
• Assignee: Marcelo Masiero Vanzin
• Reporter: Marcelo Masiero Vanzin
• Created: 04/Aug/14 19:49
• Updated: 01/Jan/15 17:50
• Resolved: 20/Aug/14 23:23

Description

As discussed in SPARK-2420, this task covers the work of shading Guava in Spark deliverables so that they don't conflict with the Hadoop classpath (nor user's classpath).

Since one Guava class is exposed through Spark's API, that class will be forked from 14.0.1 (current version used by Spark) and excluded from any shading.

The end result is that Spark's Guava won't be exposed to users anymore. This has the side-effect of effectively downgrading to version 11 (the one used by Hadoop) for those that do not explicitly depend on / package Guava with their apps.

Issue Links

• is depended upon by: SPARK-3145 Hive on Spark umbrella
• is related to: SPARK-3217 Shaded Guava jar doesn't play well with Maven build when SPARK_PREPEND_CLASSES is set
• relates to: SPARK-5052 com.google.common.base.Optional binary has a wrong method signatures
• links to: [Github] Pull Request #1813 (vanzin)